Motion based calendaring, mapping, and event information coordination and interaction interfaces, apparatuses, systems, and methods making and implementing same

ABSTRACT

Apparatuses, systems, interfaces, and methods using motion based processing to display, manipulate, coordinate, and/or evidence interaction between calendar and map data or calendar, map, and optionally event data, and methods making and implementing same.

RELATED APPLICATIONS

This application claims the benefit of and priority to U.S. ProvisionalPatent Application Ser. No. 62/566,479 filed 1 Oct. 2017.

BACKGROUND OF THE INVENTION 1. Field of the Invention

Embodiments of the present disclosure relate to apparatuses, systems,interfaces, and methods using relational, interactive, and motion basedprocessing including holds and timed events, to display, manipulate,coordinate, and/or evidence interaction between scheduler, eventschedule, calendar, and map data or scheduler, event schedule calendar,map, and event data, and methods making and implementing same.

In particular, embodiments of the present disclosure relate tointerfaces, systems and methods using relational, interactive, motionbased calendaring, mapping, and event information coordination andinteraction interfaces, apparatuses, systems, and methods making andusing same, wherein the interfaces/apparatuses/systems include at leastone sensor capable of sensing motion, at least one processing unit, atleast one display devices, and a power supply and the methods receivesensor data corresponding to motion sensed by the sensor and processingthe motion into command functions to coordinated and/or interact withcalendar data, location or map data, and optionally event data.

2. Description of the Related Art

While many systems and methods have been purposed for allowing users tointeract with virtual reality environments, there is still a need in theart for improved systems and methods for interacting with virtualreality environments.

SUMMARY OF THE INVENTION

Embodiments of this disclosure provide apparatuses, systems andinterfaces including at least one motion sensor, at least one processingunit, at least one display devices, and a power supply and the methodsto receive sensor data corresponding to motion sensed by the sensor andprocessing the motion into command functions to coordinated and/orinteract with calendar data, location or map data, and optionally eventdata. The apparatuses, systems and interfaces are configured to receiveoutput from the at least one motion sensor relating to location andmotion within a 2D or 3D construct capable of simultaneously displayingcalendar and map data. In certain embodiments, the 2D or 3D constructcapable of simultaneously displaying calendar, map, and event data.

Embodiments of this disclosure provide methods using an apparatuses,systems and interfaces of this disclosure, where the methods includesensing location and sensing motion in an active zone of a motionsensor, causing a processing unit to display a calendar in a firstdisplay window and a map in a second display window of a display device,and causing the processing unit to scroll through a list of events setforth in the calendar. The methods also include sensing a second motion,which may be a hold over a particular calendar event or a change indirection of motion over a particular calendar event, and causing theprocessing unit to draw a line or light beam or other means of providingrelational data from the map to a list of locations, the event to alocation on the map corresponding to the event location, the calendar toan event(s), or the event(s) to the map, or any combination or multiplesof these. These aspects may be thought of as dimensions of a scheduler,and these dimensions may each be represented on their own plan, oroverlapping planes, or volumes. These dimensions are typically alignedwith an axis, so in this scheduler example, the 3 axes may represent map(geo location), calendar (or temporal data) and event (informationaldata). In certain embodiments, the systems may also include contacts,messages, and calls so that the data may be used for a new type ofcontact manager, and any axes could be replaces with maps, calendars,event info, or other data.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention can be better understood with reference to the followingdetailed description together with the appended illustrative drawings inwhich like elements are numbered the same:

FIGS. 1A-D depict a sequence of flat or 2D displayed map and calendarshowing visualization of associated calendar and map data andinteractions thereof.

FIG. 2A-D depict a sequence of flat or 2D displayed map, calendar, andevent data showing visualization of associated calendar, map, and eventdata and interactions thereof.

FIG. 3A-D depict a sequence of 3D displayed map and calendar showingvisualization of associated calendar and map data and interactionsthereof.

FIG. 4A-D depict a sequence of 3D displayed map, calendar, and eventdata showing visualization of associated calendar, map, and event dataand interactions thereof.

DEFINITIONS USED IN THE INVENTION

The term “at least one” means one or more or one or a plurality,additionally, these three terms may be used interchangeably within thisapplication. For example, at least one device means one or more devicesor one device and a plurality of devices.

The term “one or a plurality” means one item or a plurality of items.

The term “about” means that a value of a given quantity is within +20%of the stated value. In other embodiments, the value is within +15% ofthe stated value. In other embodiments, the value is within +10% of thestated value. In other embodiments, the value is within +5% of thestated value. In other embodiments, the value is within +2.5% of thestated value. In other embodiments, the value is within +1% of thestated value.

The term “substantially” means that a value of a given quantity iswithin +5% of the stated value. In other embodiments, the value iswithin +2.5% of the stated value. In other embodiments, the value iswithin +2% of the stated value. In other embodiments, the value iswithin +1% of the stated value. In other embodiments, the value iswithin +0.1% of the stated value.

The term “motion” and “movement” are often used interchangeably and meanmotion or movement that is capable of being detected by a motion sensorwithin an active zone of the sensor. Thus, if the sensor is a forwardviewing sensor and is capable of sensing motion within a forwardextending conical active zone, then movement of anything within thatactive zone that meets certain threshold detection criteria, will resultin a motion sensor output, where the output may include at leastdirection, angle, distance/displacement, duration, velocity, and/oracceleration. This may include the use of gestures for interaction aswell, as gestures are a subset of motion events. Moreover, if the sensoris a touch screen or multitouch screen sensor and is capable of sensingmotion on its sensing surface, then movement of anything on that activezone that meets certain threshold detection criteria, will result in amotion sensor output, where the output may include at least direction,angle, distance/displacement, duration, velocity, and/or acceleration.Of course, the sensors do not need to have threshold detection criteria,but may simply generate output anytime motion or any kind is detected.The processing units can then determine whether the motion is anactionable motion or movement and a non-actionable motion or movement.

The term “motion sensor” or “motion sensing component” means any sensoror component capable of sensing motion of any kind by anything with anactive zone area or volume, regardless of whether the sensor's orcomponent's primary function is motion sensing. Of course, the same istrue of sensor arrays regardless of the types of sensors in the arraysor for any combination of sensors and sensor arrays.

The term “eye tracking sensor” means any sensor capable of tracking eyemovement such as eye tracking glasses, eye tracking cameras, or anyother eye tracking sensor.

The term “real object” or “real world object” means any real worlddevice, attribute, or article that is capable of being controlled by aprocessing unit. Real objects include objects or articles that have realworld presence including physical, mechanical, electro-mechanical,magnetic, electro-magnetic, electrical, or electronic devices or anyother real world device that can be controlled by a processing unit.

The term “virtual object” means any construct generated in or attributeassociated with a virtual world or by a computer and displayed by adisplay device and that are capable of being controlled by a processingunit. Virtual objects include objects that have no real world presence,but are still controllable by a processing unit. These objects includeelements within a software system, product or program such as icons,list elements, menu elements, applications, files, folders, archives,generated graphic objects, 1D, 2D, 3D, and/or nD graphic images orobjects, generated real world objects such as generated people,generated animals, generated devices, generated plants, generatedlandscapes and landscape objects, generate seascapes and seascapeobjects, generated skyscapes or skyscape objects, 1D, 2D, 3D, and/or nDzones, 2D, 3D, and/or nD areas, 1D, 2D, 3D, and/or nD groups of zones,2D, 3D, and/or nD groups or areas, volumes, attributes such ascharacteristics, quantity, shape, zonal, field, affecting influencechanges or the like, or any other generated real world or imaginaryobjects or attributes. Augmented reality is a combination of real andvirtual objects and attributes.

The term “entity” means a human or an animal or robot or robotic system(autonomous or non-autonomous.

The term “entity object” means a human or a part of a human (fingers,hands, toes, feet, arms, legs, eyes, head, body, etc.), an animal or aport of an animal (fingers, hands, toes, feet, arms, legs, eyes, head,body, etc.), or a real world object under the control of a human or ananimal or a robot and include such articles as pointers, sticks, or anyother real world object that can be directly or indirectly controlled bya human or animal or a robot.

The term “mixtures” mean different data or data types are mixedtogether.

The term “combinations” mean different data or data types are in packetsor bundles, but separate.

The term “sensor data” mean data derived from at least one sensorincluding user data, motion data, environment data, temporal data,contextual data, historical data, or mixtures and combinations thereof.

The term “user data” mean user attributes, attributes of entities underthe control of the user, attributes of members under the control of theuser, information or contextual information associated with the user, ormixtures and combinations thereof.

The terms “user features”, “entity features”, and “member features”means features including: overall user, entity, or member shape,texture, proportions, information, matter, energy, state, layer, size,surface, zone, area, any other overall feature, and mixtures orcombinations thereof; specific user, entity, or member part shape,texture, proportions, any other part feature, and mixtures orcombinations thereof; and particular user, entity, or member dynamicshape, texture, proportions, any other part feature, and mixtures orcombinations thereof; and mixtures or combinations thereof.

The term “motion data or movement data” mean one or a plurality ofmotion or movement properties detectable by motion sensor or sensorscapable of sensing movement.

The term “motion or movement properties” mean properties associated withthe motion data including motion/movement direction (linear,curvilinear, circular, elliptical, etc.), motion/movementdistance/displacement, motion/movement duration, motion/movementvelocity (linear, angular, etc.), motion/movement acceleration (linear,angular, etc.), motion signature manner of motion/movement(motion/movement properties associated with the user, users, objects,areas, zones, or combinations of thereof), dynamic motion propertiessuch as motion in a given situation, motion learned by the systems basedon user interaction with the systems, motion characteristics based onthe dynamics of the environment, influences or affectations, changes inany of these attributes, and mixtures or combinations thereof. Motion ormovement based data is not restricted to the movement of a single body,body part, and/or member under the control of an entity, but may includemovement of one or any combination of movements. Additionally, theactual body, body part and/or member's identity is also considered amovement attribute. Thus, the systems/apparatuses, and/or interfaces ofthis disclosure may use the identity of the body, body part and/ormember to select between different set of objects that have beenpre-defined or determined base on environment, context, and/or temporaldata.

The term “gesture” means a predefined movement or posture preformed in aparticular manner such as closing a fist lifting a finger that iscaptured compared to a set of predefined movements that are tied via alookup table to a single function and if and only if, the movement isone of the predefined movements does a gesture based system actually goto the lookup and invoke the predefined function.

The term “environment data” mean data associated with the user'ssurrounding or environment such as location (GPS, etc.), type oflocation (home, office, store, highway, road, etc.), extent of thelocation, context, frequency of use or reference, and mixtures orcombinations thereof.

The term “temporal data” mean data associated with time of day, day ofmonth, month of year, any other temporal data, and mixtures orcombinations thereof.

The term “contextual data” mean data associated with user activities,environment activities, environmental states, frequency of use orassociation, orientation of objects, devices or users, association withother devices and systems, temporal activities, and mixtures orcombinations thereof.

The term “historical data” means data associated with past events andcharacteristics of the user, the objects, the environment and thecontext, or any combinations thereof.

The term “simultaneous” or “simultaneously” means that an action occurseither at the same time or within a small period of time. Thus, asequence of events are considered to be simultaneous if they occurconcurrently or at the same time or occur in rapid succession over ashort period of time, where the short period of time ranges from about 1nanosecond to 5 second. In other embodiments, the period range fromabout 1 nanosecond to 1 second. In other embodiments, the period rangefrom about 1 nanosecond to 0.5 seconds. In other embodiments, the periodrange from about 1 nanosecond to 0.1 seconds. In other embodiments, theperiod range from about 1 nanosecond to 1 millisecond. In otherembodiments, the period range from about 1 nanosecond to 1 microsecond.

The term “and/or” means mixtures or combinations thereof so that whetheran and/or connectors is used, the and/or in the phrase or clause orsentence may end with “and mixtures or combinations thereof.

The term “spaced apart” means that objects displayed in a window of adisplay device are separated one from another in a manner that improvesan ability for the systems, apparatuses, and/or interfaces todiscriminate between object based on movement sensed by motion sensorsassociated with the systems, apparatuses, and/or interfaces.

The term “maximally spaced apart” means that objects displayed in awindow of a display device are separated one from another in a mannerthat maximized a separation between the object to improve an ability forthe systems, apparatuses, and/or interfaces to discriminate betweenobject based on movement sensed by motion sensors associated with thesystems, apparatuses, and/or interfaces.

The term “hold” means to remain stationary at a display location for afinite duration generally between about 1 μs to about 1 s.

The term “brief hold” means to remain stationary at a display locationfor a finite duration generally between about 1 μs to about 1 ms.

The term “microhold” or micro duration hold” means to remain stationaryat a display location for a finite duration generally between about 1 μsto about 500 μs. In certain embodiments, the microhold is between about10 μs to about 500 μs. In certain embodiments, the microhold is betweenabout 100 μs to about 500 μs. In certain embodiments, the microhold isbetween about 200 μs to about 500 μs.

DETAILED DESCRIPTION OF THE INVENTION

The inventors have found that motion-based apparatuses, interfaces,systems and methods for displaying, manipulating, and interacting withscheduler, calendar, map, and optionally event data maybe implemented,wherein the interfaces/apparatuses/systems include at least one motionsensor, at least one processing unit, at least one display devices, anda power supply and the methods receive sensor data corresponding tomotion sensed by the sensor and processing the motion into commandfunctions to coordinated and/or interact with calendar data, location ormap data, and optionally event data. In certain embodiments, theapparatuses, interfaces, systems and methods may be integrated withmapping applications so that the apparatuses, interfaces, systems andmethods will allow the user to view restaurants, stores, gas stations,or other retail establishments in proximity of the venue or to provideinformation to a user on traveling to and from hotels and the venue orany other type of interactive map function. In other embodiments, theapparatuses, interfaces, systems and methods may be integrated withinteractive 3-D venue applications that will permit the user to view theactual layout of the venue. In other embodiments, the calendar, map, andevent data may be interactive so that the calendar, map, and event datamay be free form so that motion based event selection and correlatedvenue location and event data may be distributed in free form as well.

Motion Based Calendaring Interfaces

Embodiments of this disclosure broadly relate to methods comprisingreceiving first input from a motion sensor; displaying a calendar and amap in response to the first input, where the calendar includes aplurality of events and the map correlates with event locations;determining that the first input corresponds to motion towards aparticular event on the calendar; and generating a ray or beam emanatingfrom the particular event to a location on the map corresponding to thelocation of the particular event. In certain embodiments, the methodsfurther comprise receiving a further input from the motion sensor;determining that the further input corresponds to motion towards afurther event on the calendar; and generating a further ray or beamemanating from the further particular event to a further location on themap corresponding to the location of the further particular event. Inother embodiments, the methods further comprise generating a lineconnecting the first location to the further location evidencing adirection of travel from the first location to the further location.

In other embodiments, the methods further comprise repeating the stepsof claims 1 and 2 until all desired events and associated with rays orbeams are displayed on the display device. In other embodiments, themethods further comprise repeating the steps of claims 1, 2 and 3 untilall desired events and associated with rays or beams and all connectinglines are displayed on the display device. In other embodiments, themethods further comprise displaying event related data in a event datafield on the display. In other embodiments, the methods further comprisedisplaying event related data in a event data field on the display. Inother embodiments, the methods further comprise displaying event relateddata in a event data field on the display. In other embodiments, thecalendar and the map are displayed in a two dimensional format with thecalendar displayed on top of the map or the map is displayed on top ofthe calendar. In other embodiments, the calendar and the map aredisplayed in a three dimensional format with the map displayed in axz-plane and the calendar displayed in an xy-plane. In otherembodiments, the map, and the event are displayed in a two dimensionalformat with (a) the calendar displayed on top of the map and the map ontop of the event data field or (b) the map is displayed on top of thecalendar and the calendar on top of the event data field. In otherembodiments, the the calendar and the map are displayed in a threedimensional format with the map displayed in a xz-plane, the calendardisplayed in an xy-plane, and the even data field is displayed on ayz-plane. In other embodiments, the methods further comprise displayinglines extending from events to event data displayed on in the event datafield and lines extending from the associated locations to the eventdata displayed in the event data field on the display. In otherembodiments, the methods further comprise displaying lines extendingfrom events to event data displayed on in the event data field and linesextending from the associated locations to the event data displayed inthe event data field on the display.

Embodiments of this disclosure broadly relate to mobile devicescomprising a display device; and a processor configured to (a)responsive to first input, initiate display of a calendar and a map onthe display device, where the calendar includes a plurality of eventsand the map correlates with event locations; and (b) responsive to thefirst input determine that first input corresponds to motion towards aparticular event on the calendar and generate a ray or beam emanatingfrom the particular event to a location on the map corresponding to thelocation of the particular event. In certain embodiments, the devicesmay implement any of the methods steps set forth above.

Embodiments of this disclosure broadly relate to system comprising adisplay device configured to (a) display a calendar and a map intwo-dimensions or in three-dimensions; and a processor, coupled to thedisplay device and configured to (a) receive a first input from a motionsensor, (b) cause the display device to display the calendar and themap, where the calendar includes a plurality of events and the mapcorrelates with event locations, and (c) in response to the first inputdetermine that first input corresponds to motion towards a particularevent on the calendar and generate a ray or beam emanating from theparticular event to a location on the map corresponding to the locationof the particular event. In certain embodiments, the systems mayimplement any of the methods steps set forth above.

General Motion Based Interfaces

The inventors have also found that selection attractive or manipulativeapparatuses, systems, and/or interfaces may be constructed that usemotion or movement within an active sensor zone of a motion sensortranslated to motion or movement of a selection object on or within auser feedback device: 1) to discriminate between selectable objectsbased on the motion, 2) to attract target selectable objects towards theselection object based on properties of the sensed motion includingdirection, speed, acceleration, or changes thereof, and 3) to select andsimultaneously activate a particular or target selectable object or aspecific group of selectable objects or controllable area or anattribute or attributes upon “contact” of the selection object with thetarget selectable object(s), where contact means that: 1) the selectionobject actually touches or moves inside the target selectable object, 2)touches or moves inside an active zone (area or volume) surrounding thetarget selectable object, 3) the selection object and the targetselectable object merge, 4) a triggering event occurs based on a closeapproach to the target selectable object or its associated active zoneor 5) a triggering event based on a predicted selection meeting athreshold certainty. The touch, merge, or triggering event causes theprocessing unit to select and activate the object, select and activeobject attribute lists, select, activate and adjustments of anadjustable attribute. The objects may represent real and/or virtualobjects including: 1) real world devices under the control of theapparatuses, systems, or interfaces, 2) real world device attributes andreal world device controllable attributes, 3) software includingsoftware products, software systems, software components, softwareobjects, software attributes, active areas of sensors, 4) generated EMFfields, RF fields, microwave fields, or other generated fields, 5)electromagnetic waveforms, sonic waveforms, ultrasonic waveforms, and/or6) mixture and combinations thereof. The apparatuses, systems andinterfaces of this invention may also include remote control units inwired or wireless communication therewith. The inventor has also foundthat a velocity (speed and direction) of motion or movement can be usedby the apparatuses, systems, or interfaces to pull or attract one or agroup of selectable objects toward a selection object and increasingspeed may be used to increase a rate of the attraction of the objects,while decreasing motion speed may be used to slower a rate of attractionof the objects. The inventors have also found that as the attractedobject move toward the selection object, they may be augmented in someway such as changed size, changed color, changed shape, changed linethickness of the form of the object, highlighted, changed to blinking,or combinations thereof. Simultaneously, synchronously orasynchronously, submenus or subobjects may also move or change inrelation to the movements or changes of the selected objects.Simultaneously, synchronously or asynchronously, the non-selectedobjects may move away from the selection object(s). It should be notedthat whenever a word object is used, it also includes the meaning ofobjects, and these objects may be simultaneously performing separate,simultaneous, and/or combined command functions or used by theprocessing units to issue combinational functions.

in certain embodiments, as the selection object moves toward a targetobject, the target object will get bigger as it moves toward theselection object. It is important to conceptualize the effect we arelooking for. The effect may be analogized to the effects of gravity onobjects in space. Two objects in space are attracted to each other bygravity proportional to the product of their masses and inverselyproportional to the square of the distance between the objects. As theobjects move toward each other, the gravitational force increasespulling them toward each other faster and faster. The rate of attractionincreases as the distance decreases, and they become larger as they getcloser. Contrarily, if the objects are close and one is moved away, thegravitational force decreases and the objects get smaller. In thepresent invention, motion of the selection object away from a selectableobject may act as a rest, returning the display back to the originalselection screen or back to the last selection screen much like a “back”or “undo” event. Thus, if the user feedback unit (e.g., display) is onelevel down from the top display, then movement away from any selectableobject, would restore the display back to the main level. If the displaywas at some sublevel, then movement away from selectable objects in thissublevel would move up a sublevel. Thus, motion away from selectableobjects acts to drill up, while motion toward selectable objects thathave sublevels results in a drill down operation. Of course, if theselectable object is directly activatable, then motion toward it selectsand activates it. Thus, if the object is an executable routine such astaking a picture, then contact with the selection object, contact withits active area, or triggered by a predictive threshold certaintyselection selects and simultaneously activates the object. Once theinterface is activated, the selection object and a default menu of itemsmay be activated on or within the user feedback unit. If the directionof motion towards the selectable object or proximity to the active areaaround the selectable object is such that the probability of selectionis increased, the default menu of items may appear or move into aselectable position, or take the place of the initial object before theobject is actually selected such that by moving into the active area orby moving in a direction such that a commit to the object occurs, andsimultaneously causes the subobjects or submenus to move into a positionready to be selected by just moving in their direction to causeselection or activation or both, or by moving in their direction untilreaching an active area in proximity to the objects such that selection,activation or a combination of the two occurs. The selection object andthe selectable objects (menu objects) are each assigned a massequivalent or gravitational value of 1. The difference between whathappens as the selection object moves in the display area towards aselectable object in the present interface, as opposed to real life, isthat the selectable objects only feel the gravitation effect from theselection object and not from the other selectable objects. Thus, in thepresent invention, the selectable object is an attractor, while theselectable objects are non-interactive, or possibly even repulsive toeach other. So as the selection object is moved in response to motion bya user within the motion sensors active zone such as motion of a fingerin the active zone the processing unit maps the motion and generatescorresponding movement or motion of the selection object towardsselectable objects in the general direction of the motion. Theprocessing unit then determines the projected direction of motion andbased on the projected direction of motion, allows the gravitationalfield or attractive force of the selection object to be felt by thepredicted selectable object or objects that are most closely alignedwith the direction of motion. These objects may also include submenus orsubobjects that move in relation to the movement of the selectedobject(s). This effect would be much like a field moving and expandingor fields interacting with fields, where the objects inside the field(s)would spread apart and move such that unique angles from the selectionobject become present so movement towards a selectable object or groupof objects can be discerned from movement towards a different object orgroup of objects, or continued motion in the direction of the second ormore of objects in a line would cause the objects to not be selectedthat had been touched or had close proximity, but rather the selectionwould be made when the motion stops, or the last object in the directionof motion is reached, and it would be selected. The processing unitcauses the display to move those object toward the selectable object.The manner in which the selectable object moves may be to move at aconstant velocity towards a selection object or to accelerate toward theselection object with the magnitude of the acceleration increasing asthe movement focuses in on the selectable object. The distance moved bythe person and the speed or acceleration may further compound the rateof attraction or movement of the selectable object towards the selectionobject. In certain situations, a negative attractive force orgravitational effect may be used when it is more desired that theselected objects move away from the user. Such motion of the objectswould be opposite of that described above as attractive. As motioncontinues, the processing unit is able to better discriminate betweencompeting selectable objects and the one or ones more closely alignedare pulled closer and separated, while others recede back to theiroriginal positions or are removed or fade. If the motion is directlytoward a particular selectable object with a certainty above a thresholdvalue, which has a certainty of greater than 50%, then the selection andselectable objects merge and the selectable object is simultaneouslyselected and activated. Alternatively, the selectable object may beselected prior to merging with the selection object if the direction,speed and/or acceleration of the selection object is such that theprobability of the selectable object is enough to cause selection, or ifthe movement is such that proximity to the activation area surroundingthe selectable object is such that the threshold for selection,activation or both occurs. Motion continues until the processing unit isable to determine that a selectable object has a selection threshold ofgreater than 50%, meaning that it more likely than not the correcttarget object has been selected. In certain embodiments, the selectionthreshold will be at least 60%. In other embodiments, the selectionthreshold will be at least 70%. In other embodiments, the selectionthreshold will be at least 80%. In yet other embodiments, the selectionthreshold will be at least 90%.

in certain embodiments, the selection object will actually appear on thedisplay screen, while in other embodiments, the selection object willexist only virtually in the processor software. For example, for motionsensors that require physical contact for activation such as touchscreens, the selection object may be displayed and/or virtual, withmotion on the screen used to determine which selectable objects from adefault collection of selectable objects will be moved toward aperceived or predefined location of a virtual section object or towardthe selection object in the case of a displayed selection object, whilea virtual object simply exists in software such as at a center of thedisplay or a default position to which selectable object are attracted,when the motion aligns with their locations on the default selection. Inthe case of motion sensors that have active zones such as cameras, IRsensors, sonic sensors, or other sensors capable of detecting motionwithin an active zone and creating an output representing that motion toa processing unit that is capable of determining direction, speed and/oracceleration properties of the sensed or detected motion, the selectionobject is generally virtual and motion of one or more body parts of auser is used to attract a selectable object or a group of selectableobjects to the location of the selection object and predictive softwareis used to narrow the group of selectable objects and zero in on aparticular selectable object, objects, objects and attributes, and/orattributes. In certain embodiments, the interface is activated from asleep condition by movement of a user or user body part in to the activezone of the motion sensor or sensors associated with the interface. Onceactivated, the feedback unit such as a display associated with theinterface displays or evidences in a user discernible manner a defaultset of selectable objects or a top level set of selectable objects. Theselectable objects may be clustered in related groups of similar objectsor evenly distributed about a centroid of attraction if no selectionobject is generated on the display or in or on another type of feedbackunit. If one motion sensor is sensitive to eye motion, then motion ofthe eyes will be used to attract and discriminate between potentialtarget objects on the feedback unit such as a display screen. If theinterface is an eye only interface, then eye motion is used to attractand discriminate selectable objects to the centroid, with selection andactivation occurring when a selection threshold is exceeded greater than50% confidence that one selectable object is more closely aligned withthe direction of motion than all other objects. The speed and/oracceleration of the motion along with the direction are further used toenhance discrimination by pulling potential target objects toward thecentroid quicker and increasing their size and/or increasing theirrelative separation. Proximity to the selectable object may also be usedto confirm the selection. Alternatively, if the interface is an eye andother body part interface, then eye motion will act as the primarymotion driver, with motion of the other body part acting as aconfirmation of eye movement selections. Thus, if eye motion hasnarrowed the selectable objects to a group, which may or may notdynamically change the perspective of the user (zoom in/out, pan, tilt,roll, or any combination of changes) motion of the other body part maybe used by the processing unit to further discriminate and/orselect/activate a particular object or if a particular object meets thethreshold and is merging with the centroid, then motion of the objectbody part may be used to confirm or reject the selection regardless ofthe threshold confidence. In other embodiments, the motion sensor andprocessing unit may have a set of predetermined actions that are invokedby a given structure of a body part or a given combined motion of two ormore body parts. For example, upon activation, if the motion sensor iscapable of analyzing images, a hand holding up different number offigures from zero, a fist, to five, an open hand may cause theprocessing unit to display different base menus. For example, a fist maycause the processing unit to display the top level menu, while a singlefinger may cause the processing unit to display a particular submenu.Once a particular set of selectable objects is displayed, then motionattracts the target object, which is simultaneously selected andactivated. In other embodiments, confirmation may include a noisedgenerated by the uses such as a word, a vocal noise, a predefined vocalnoise, a clap, a snap, or other audio controlled sound generated by theuser; in other embodiments, confirmation may be visual, audio or hapticeffects or a combination of such effects. In certain embodiments, theconfirmation may be dynamic, a variable sound, color, shape, feel,temperature, distortion, or any other effect or combination of thereof.

Embodiments of this invention provide methods and systems implementingthe methods comprising the steps of sensing circular movement via amotion sensor, where the circular movement is sufficient to activate ascroll wheel, scrolling through a list associated with the scroll wheel,where movement close to the center causes a faster scroll, whilemovement further from the center causes a slower scroll andsimultaneously faster circular movement causes a faster scroll whileslower circular movement causes slower scroll. When the user stops thecircular motion, even for a very brief time, or changes direction suchthat it can be discerned to be no longer circular (such as moving in aZ-axis when the circular motion is in an X/Y plane) the list becomesstatic so that the user may move to a particular object, hold over aparticular object, or change motion direction at or near a particularobject. The whole wheel or a partial amount or portion of the wheel maybe displayed or just an arc may be displayed where scrolling moves upand down the arc. These actions cause the processing unit to select theparticular object, to simultaneously select and activate the particularobject, or to simultaneously select, activate, and control an attributeof the object. By beginning the circular motion again, anywhere on thescreen, scrolling recommences immediately. Of course, scrolling could bethrough a list of values, or actually be controlling values as well, andall motions may be in 2D or 3D environments as well.

Embodiments of the present invention also provide methods and systemsimplementing the methods including the steps of displaying an arcuatemenu layouts of selectable objects on a display field, sensing movementtoward an object pulling the object toward the user's location, user'smovement, or center based on a direction, a speed and/or an accelerationof the movement, as the selected object moves toward user or the center,displaying subobjects appear distributed in an arcuate spaced apartconfiguration about the selected object. The apparatus, system andmethods can repeat the sensing and displaying operations. In all cases,singular or multiple subobjects or submenus may be displayed between theuser and the primary object, behind, below, or anywhere else as desiredfor the interaction effect.

Embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of predicting an object'sselection based on the properties of the sensed movement, where theproperties includes direction, speed, acceleration, changes thereof, orcombinations thereof. For example, faster speed may increasepredictability, while slower speed may decrease predictability or viceversa. Alternatively, moving averages may be used to extrapolate thedesired object desired such as vector averages, linear and non-linearfunctions, including filters and multiple outputs form one or moresensors. Along with this is the “gravitational”, “electric” and/or“magnetic” attractive or repulsive effects utilized by the methods andsystems, whereby the selectable objects move towards the user orselection object and accelerates towards the user or selection object asthe user or selection object and selectable objects come closertogether. This may also occur by the user beginning motion towards aparticular selectable object, the particular selectable object begins toaccelerate towards the user or the selection object, and the user andthe selection object stops moving, but the particular selectable objectcontinues to accelerate towards the user or selection object. In thecertain embodiments, the opposite effect occurs as the user or selectionobjects moves away starting close to each other, the particularselectable object moves away quickly, but slows down its rate ofrepulsion as distance is increased, making a very smooth look. Indifferent uses, the particular selectable object might accelerate awayor return immediately to its original or predetermined position. In anyof these circumstances, a dynamic interaction is occurring between theuser or selection object and the particular selectable object(s), whereselecting and controlling, and deselecting and controlling can occur,including selecting and controlling or deselecting and controllingassociated submenus or subobjects and/or associated attributes,adjustable or invocable.

Embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of detecting at least onebio-kinetic characteristic of a user such as a fingerprint,fingerprints, a palm print, retinal print, size, shape, and texture offingers, palm, eye(s), hand(s), face, etc. or at least one EMF,acoustic, thermal or optical characteristic detectable by sonic sensors,thermal sensors, optical sensors, capacitive sensors, resistive sensors,or other sensor capable of detecting EMF fields, other dynamic waveform, or other characteristics, or combinations thereof emanating from auser, including specific movements and measurements of movements of bodyparts such as fingers or eyes that provide unique markers for eachindividual, determining an identity of the user from the bio-kineticcharacteristics, and sensing movement as set forth herein. In this way,the existing sensor for motion may also recognize the user uniquely, aswell as the motion event associated with the user. This recognition maybe further enhanced by using two or more body parts or bio-kineticcharacteristics (e.g., two fingers), and even further by body partsperforming a particular task such as being squeezed together, when theuser enters in a sensor field. Other bio-kinetic and/or biometriccharacteristics may also be used for unique user identification such asskin characteristics and ratio to joint length and spacing. Furtherexamples include the relationship between the finger(s), hands or otherbody parts and the wave, acoustic, magnetic, EMF, or other interferencepattern created by the body parts creates a unique constant and may beused as a unique digital signature. For instance, a finger in a 3Dacoustic or EMF field would create unique null and peak points or aunique null and peak pattern, so the “noise” of interacting with a fieldmay actually help to create unique identifiers. This may be furtherdiscriminated by moving a certain distance, where the motion may beuniquely identified by small tremors, variations, or the like, furthermagnified by interference patterns in the noise. This type of uniqueidentification maybe used in touch and touchless applications, but maybe most apparent when using a touchless sensor or an array of touchlesssensors, where interference patterns (for example using acousticsensors) may be present due to the size and shape of the hands orfingers, or the like. Further uniqueness may be determined by includingmotion as another unique variable, which may help in securityverification. Furthermore, by establishing a base user's bio-kineticsignature or authorization, slight variations per bio-kinetictransaction or event may be used to uniquely identify each event aswell, so a user would be positively and uniquely identified to authorizea merchant transaction, but the unique speed, angles, and variations,even at a wave form and/or wave form noise level could be used touniquely identify one transaction as compared to another.

Embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of sensing movement of afirst body part such as an eye, etc., tracking the first body partmovement until is stops, pauses or holds on an object, preliminarilyselecting the object, sensing movement of a second body part such asfinger, hand, foot, etc., confirming the preliminary selection andselecting the object. The selection may then cause the processing unitto invoke one of the command and control functions including issuing ascroll function, a simultaneous select and scroll function, asimultaneous select and activate function, a simultaneous select,activate, and attribute adjustment function, or a combination thereof,and controlling attributes by further movement of the first or secondbody parts or activating the objects if the object is subject to directactivation. These selection procedures may be expanded to the eye movingto an object (scrolling through a list or over a list), the finger orhand moving in a direction to confirm the selection and selecting anobject or a group of objects or an attribute or a group of attributes.In certain embodiments, if object configuration is predetermined suchthat an object in the middle of several objects, then the eye may movesomewhere else, but hand motion continues to scroll or controlattributes or combinations thereof, independent of the eyes. Hand andeyes may work together or independently, or a combination in and out ofthe two. Thus, movements may be compound, sequential, simultaneous,partially compound, compound in part, or combinations thereof.

Embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of capturing a movement ofa user during a selection procedure or a plurality of selectionprocedures to produce a raw movement dataset. The methods and systemsalso include the step of reducing the raw movement dataset to produce arefined movement dataset, where the refinement may include reducing themovement to a plurality of linked vectors, to a fit curve, to a splinefit curve, to any other curve fitting format having reduced storagesize, a reduced data point collection, or to any other fitting format.The methods and systems also include the step of storing the rawmovement dataset or the refined movement dataset. The methods andsystems also include the step of analyzing the refined movement datasetto produce a predictive tool for improving the prediction of a user'sselection procedure using the motion based system or to produce aforensic tool for identifying the past behavior of the user or toprocess a training tools for training the user interface to improve userinteraction with the interface.

Embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of sensing movement of aplurality of body parts simultaneously or substantially simultaneouslyand converting the sensed movement into control functions forsimultaneously controlling an object or a plurality of objects. Themethods and systems also include controlling an attribute or a pluralityof attributes, or activating an object or a plurality of objects, or anycombination thereof. For example, placing a hand on a top of a domedsurface for controlling a UAV, sensing movement of the hand on the dome,where a direction of movement correlates with a direction of flight,sensing changes in the movement on the top of the domed surface, wherethe changes correlate with changes in direction, speed, or accelerationof functions, and simultaneously sensing movement of one or morefingers, where movement of the fingers may control other features of theUAV such as pitch, yaw, roll, camera focusing, missile firing, etc. withan independent finger(s) movement, while the hand, palm or otherdesignated area of the hand is controlling the UAV, either throughremaining stationary (continuing last known command) or while the handis moving, accelerating, or changing direction of acceleration. Incertain embodiments where the display device is flexible device such asa flexible screen or flexible dome, the movement may also includedeforming the surface of the flexible device, changing a pressure on thesurface, inside the volume of the dome, or similar surface and/orvolumetric deformations. These deformations may be used in conjunctionwith the other motions.

Embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of populating a displayfield with displayed primary objects and hidden secondary objects, wherethe primary objects include menus, programs, applications, attributes,devices, etc. and secondary objects include submenus, attributes,preferences, etc. The methods and systems also include sensing movement,highlighting one or more primary objects most closely aligned with adirection of the movement, predicting a primary object based on themovement, and simultaneously: (a) selecting the primary object, (b)displaying secondary objects most closely aligned with the direction ofmotion in a spaced apart configuration, (c) pulling the primary andsecondary objects toward a center of the display field or to apre-determined area of the display field, and/or (d) removing, fading,or making inactive the unselected primary and secondary objects untilmaking active again.

Alternately, zones in between primary and/or secondary objects may actas activating areas or subroutines that would act the same as theobjects. For instance, if someone were to move in between two objects in2D (a watch or mobile device), 3D space (virtual reality environmentsand altered reality environments), objects in the background could berotated to the front and the front objects could be rotated towards theback, or to a different level.

Embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of populating a displayfield with displayed primary objects and offset active fields associatedwith the displayed primary objects, where the primary objects includemenus, object lists, alphabetic characters, numeric characters, symbolcharacters, other text based characters. The methods and systems alsoinclude sensing movement, highlighting one or more primary objects mostclosely aligned with a direction of the movement, predicting a primaryobject based on the movement, context, and/or movement and context, andsimultaneously: (a) selecting the primary object, (b) displayingsecondary (tertiary or deeper) objects most closely aligned with thedirection of motion in a spaced apart configuration, (c) pulling theprimary and secondary or deeper objects toward a center of the displayfield or to a pre-determined area of the display field, and/or (d)removing, making inactive, or fading or otherwise indicatingnon-selection status of the unselected primary, secondary, and deeperlevel objects.

Embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of sensing movement of aneye and simultaneously moving elements of a list within a fixed windowor viewing pane of a display field or a display or an active objecthidden or visible through elements arranged in a 2D or 3D matrix withinthe display field, where eye movement anywhere, in any direction in adisplay field regardless of the arrangement of elements such as iconsmoves through the set of selectable objects. Of course the window may bemoved with the movement of the eye to accomplish the same scrollingthrough a set of lists or objects, or a different result may occur bythe use of both eye position in relation to a display or volume(perspective), as other motions occur, simultaneously or sequentially.Thus, scrolling does not have to be in a linear fashion, the intent isto select an object and/or attribute and/or other selectable itemsregardless of the manner of motion linear, arcuate, angular, circular,spiral, random, or the like. Once an object of interest is to beselected, then selection is accomplished either by movement of the eyein a different direction, holding the eye in place for a period of timeover an object, movement of a different body part, or any other movementor movement type that affects the selection of an object, attribute,audio event, facial posture, and/or biometric or bio-kinetic event.These same steps may be used with body only or a combination of multiplebody parts and eye or head gaze or movement.

Embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of sensing movement of aneye, selecting an object, an object attribute or both by moving the eyein a pre-described change of direction such that the change of directionwould be known and be different than a random eye movement, or amovement associated with the scroll (scroll being defined by moving theeye all over the screen or volume of objects with the intent to choose).Of course the eye may be replaced by any body part or object under thecontrol of a body part.

Embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of sensing eye movementvia a motion sensor, selecting an object displayed in a display fieldwhen the eye pauses at an object for a dwell time sufficient for themotion sensor to detect the pause and simultaneously activating theselected object, repeating the sensing and selecting until the object iseither activatable or an attribute capable of direct control. In certainembodiments, the methods also comprise predicting the object to beselected from characteristics of the movement and/or characteristics ofthe manner in which the user moves. In other embodiments, eye trackingusing gaze instead of motion for selection/control via eye focusing(dwell time or gaze time) on an object and a body motion (finger, hand,etc.) scrolls through an associated attribute list associated with theobject, or selects a submenu associated with the object. Eye gazeselects a submenu object and body motion confirms selection (selectiondoes not occur without body motion), so body motion actually affectsobject selection.

In other embodiments, eye tracking using motion for selection/controleye movement is used to select a first word in a sentence of a worddocument. Selection is confirmed by body motion of a finger (e.g., rightfinger) which holds the position. Eye movement is then tracked to thelast word in the sentence and another finger (e.g., the left finger)confirms selection. Selected sentence is highlighted due to secondmotion defining the boundary of selection. The same effect may be had bymoving the same finger towards the second eye position (the end of thesentence or word). Movement of one of the fingers towards the side ofthe monitor (movement is in different direction than the confirmationmove) sends a command to delete the sentence. Alternatively, movement ofeye to a different location, followed by both fingers moving generallytowards that location results in the sentence being copied to thelocation at which the eyes stopped. This may also be used in combinationwith a gesture or with combinations of motions and gestures such as eyemovement and other body movements concurrently multiple inputs at oncesuch as UAV controls described below.

In other embodiments, looking at the center of picture or article andthen moving one finger away from center of picture or center of bodyenlarges the picture or article (zoom in). Moving finger towards centerof picture makes picture smaller (zoom out). What is important tounderstand here is that an eye gaze point, a direction of gaze, or amotion of the eye provides a reference point for body motion andlocation to be compared. For instance, moving a body part (say a finger)a certain distance away from the center of a picture in a touch ortouchless, 2D or 3D environment (area or volume as well), may provide adifferent view. For example, if the eye(s) were looking at a centralpoint in an area, one view would appear, while if the eye(s) werelooking at an edge point in an area, a different view would appear. Therelative distance of the motion would change, and the relative directionmay change as well, and even a dynamic change involving both eye(s) andfinger, could provide yet another change of motion. For example, bylooking at the end of a stick and using the finger to move the other endof it, the pivot point would be the end the eyes were looking at. Bylooking at the middle of the stick, then using the finger to rotate theend, the stick would pivot around the middle. Each of these movement maybe used to control different attributes of a picture, screen, display,window, or volume of a 3D projection, etc. What now takes two fingersmay be replaced by one due to the eye(s) acting as the missing finger.

These concepts are useable to manipulate the view of pictures, images,3D data or higher dimensional data, 3D renderings, 3D buildingrenderings, 3D plant and facility renderings, or any other type of 3D orhigher dimensional pictures, images, or renderings. These manipulationsof displays, pictures, screens, etc. may also be performed without thecoincidental use of the eye, but rather by using the motion of a fingeror object under the control or a user, such as by moving from one lowercorner of a bezel, screen, or frame (virtual or real) diagonally to theopposite upper corner to control one attribute, such as zooming in,while moving from one upper corner diagonally to the other lower cornerwould perform a different function, for example zooming out. This motionmay be performed as a gesture, where the attribute change might occur inat predefined levels, or may be controlled variably so the zoom in/outfunction may be a function of time, space, and/or distance. By movingfrom one side or edge to another, the same predefined level of change,or variable change may occur on the display, picture, frame, or thelike. For example, a TV screen displaying a picture and zoom-in may beperformed by moving from a bottom left corner of the frame or bezel, oran identifiable region (even off the screen) to an upper right potion.As the user moves, the picture is magnified (zoom-in). By starting in anupper right corner and moving toward a lower left, the system causes thepicture to be reduced in size (zoom-out) in a relational manner to thedistance or speed the user moves. If the user makes a quick diagonallydownward movement from one upper corner to the other lower corner, thepicture may be reduced by 50% (for example). This eliminates the needfor using two fingers that is currently popular as a pinch/zoomfunction.

By the user moving from a right side of the frame or bezel or predefinedlocation towards a left side, an aspect ratio of the picture may bechanged so as to make the picture tall and skinny By moving from a topedge toward a bottom edge, the picture may cause the picture to appearshort and wide. By moving two fingers from one upper corner diagonallytowards a lower corner, or from side to side, a “cropping” function maybe used to select certain aspects of the picture.

By taking one finger and placing it near the edge of a picture, frame,or bezel, but not so near as to be identified as desiring to use a sizeor crop control, and moving in a rotational or circular direction, thepicture could be rotated variably, or if done in a quick gesturalmotion, the picture might rotate a predefined amount, for instance 90degrees left or right, depending on the direction of the motion.

By moving within a central area of a picture, the picture may be moved“panned” variably by a desired amount or panned a preset amount, say 50%of the frame, by making a gestural motion in the direction of desiredpanning. Likewise, these same motions may be used in a 3D environmentfor simple manipulation of object attributes. These are not specificmotions using predefined pivot points as is currently used in CADprograms, but is rather a way of using the body (eyes or fingers forexample) in broad areas. These same motions may be applied to anydisplay, projected display or other similar device. In a mobile device,where many icons (objects) exist on one screen, where the icons includefolders of “nested” objects, by moving from one lower corner of thedevice or screen diagonally toward an upper corner, the display may zoomin, meaning the objects would appear magnified, but fewer would bedisplayed. By moving from an upper right corner diagonally downward, theicons would become smaller, and more could be seen on the same display.Moving in a circular motion near an edge of the display may causerotation of the icons, providing scrolling through lists and pages oficons. Moving from one edge to an opposite edge would change the aspectratio of the displayed objects, making the screen of icons appearshorter and wider, or taller and skinny, based on the direction moved.

In other embodiments, looking at a menu object then moving a finger awayfrom object or center of body opens up sub menus. If the objectrepresents a software program such as excel, moving away opens upspreadsheet fully or variably depending on how much movement is made(expanding spreadsheet window).

In other embodiments, instead of being a program accessed through anicon, the program may occupy part of a 3D space that the user interactswith or a field coupled to the program acting as a sensor for theprogram through which the user to interacts with the program. In otherembodiments, if object represents a software program such as Excel andseveral (say 4) spreadsheets are open at once, movement away from theobject shows 4 spread sheet icons. The effect is much like pullingcurtain away from a window to reveal the software programs that areopened. The software programs might be represented as “dynamic fields”,each program with its own color, say red for excel, blue for word, etc.The objects or aspects or attributes of each field may be manipulated byusing motion. For instance, if a center of the field is considered to bean origin of a volumetric space about the objects or value, moving at anexterior of the field cause a compound effect on the volume as a wholedue to having a greater x value, a greater y value, or a great z valuesay the maximum value of the field is 5 (x, y, or z), moving at a 5point would be a multiplier effect of 5 compared to moving at a value of1 (x, y, or z). The inverse may also be used, where moving at a greaterdistance from the origin may provide less of an effect on part or thewhole of the field and corresponding values. Changes in color, shape,size, density, audio characteristics, or any combination of these andother forms of representation of values could occur, which may also helpthe user or users to understand the effects of motion on the fields.These may be preview panes of the spreadsheets or any other iconsrepresenting these. Moving back through each icon or moving the fingerthrough each icon or preview pane, then moving away from the icon orcenter of the body selects the open programs and expands them equally onthe desktop, or layers them on top of each other, etc. These actions maybe combined, i.e. in AR/VR environments, where motion of the eyes andfinger and another hand (or body) can each or in combination have apredetermined axis or axes to display menus and control attributes orchoices that maybe stationary or dynamic, and may interact with eachother, so different combinations of eye, body and hand may provide thesame results (redundantly), or different results based on thecombination or sequence of motions and holds, gazes, and even pose orposture in combination with these. Thus, motion in multiple axes maymove in compound ways to provide redundant or different effects,selection and attribute controls.

In other embodiments, four Word Documents (or any program or web pages)are open at once. Movement from bottom right of the screen to top leftreveals the document at bottom right of page, effect looks like pullingcurtain back. Moving from top right to bottom left reveals a differentdocument. Moving from across the top, and circling back across thebottom opens all, each in its quadrant, then moving through the desireddocuments and creating circle through the objects links them alltogether and merges the documents into one document. As another example,the user opens three spreadsheets and dynamically combines or separatesthe spreadsheets merely via motions or movements, variably per amountand direction of the motion or movement. Again, the software or virtualobjects are dynamic fields, where moving in one area of the field mayhave a different result than moving in another area, and the combiningor moving through the fields causes a combining of the softwareprograms, and maybe done dynamically. Furthermore, using the eyes tohelp identify specific points in the fields (2D or 3D) would aid indefining the appropriate layer or area of the software program (field)to be manipulated or interacted with. Dynamic layers within these fieldsmay be represented and interacted with spatially in this manner. Some orall the objects may be affected proportionately or in some manner by themovement of one or more other objects in or near the field. Of course,the eyes may work in the same manner as a body part or in combinationwith other objects or body parts. In all cases, contextual,environmental, prioritized, and weighted averages or densities andprobabilities my affect the interaction and aspect view of the field andthe data or objects associated with the field(s). For instance, creatinga graphic representation of values and data points containing RNA, DNA,family historical data, food consumption, exercise, etc., would interactdifferently if the user began interacting closer to the RNA zone than tothe food consumption zone, and the filed would react differently in partor throughout as the user moved some elements closer to others or in adifferent sequence from one are to another. This dynamic interaction andvisualization would be expressive of weighted values or combinations ofelements to reveal different outcomes.

In other embodiments, the eye selects (acts like a cursor hovering overan object and object may or may not respond, such as changing color toidentify it has been selected), then a motion or gesture of eye or adifferent body part confirms and disengages the eyes for furtherprocessing.

In other embodiments, the eye selects or tracks and a motion or movementor gesture of second body part causes a change in an attribute of thetracked object such as popping or destroying the object, zooming,changing the color of the object, etc. finger is still in control of theobject.

In other embodiments, eye selects, and when body motion and eye motionare used, working simultaneously or sequentially, a different resultoccurs compared to when eye motion is independent of body motion, e.g.,eye(s) tracks a bubble, finger moves to zoom, movement of the fingerselects the bubble and now eye movement will rotate the bubble basedupon the point of gaze or change an attribute of the bubble, or the eyemay gaze and select and/or control a different object while the fingercontinues selection and/or control of the first objector a sequentialcombination could occur, such as first pointing with the finger, thengazing at a section of the bubble may produce a different result thanlooking first and then moving a finger; again a further difference mayoccur by using eyes, then a finger, then two fingers than would occur byusing the same body parts in a different order.

Other embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of: controlling helicopterwith one hand on a domed interface, where several fingers and hand allmove together and move separately. In this way, the whole movement ofthe hand controls the movement of the helicopter in yaw, pitch and roll,while the fingers may also move simultaneously to control cameras,artillery, or other controls or attributes, or both. This is movement ofmultiple inputs simultaneously congruently or independently.

In certain embodiments, the perspective of the user as gravitationaleffects and object selections are made in 3D space. For instance, as wemove in 3D space towards subobjects, using our previously submittedgravitational and predictive effects, each selection may change theentire perspective of the user so the next choices are in the center ofview or in the best perspective. This may include rotational aspects ofperspective, the goal being to keep the required movement of the usersmall and as centered as possible in the interface real estate. This isreally showing the aspect, viewpoint or perspective of the user, and isrelative. Since we are saying the objects and fields may be moved, orsaying the user may move around the field, it is really a relative.

Other embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of sensing movement of abutton or knob with motion controls associated therewith, either on topof or in 3D, 3 space, on sides (whatever the shape), predicting whichgestures are called by direction and speed of motion (maybe amendment togravitational/predictive application). By definition, a gesture has apose-movement-pose then lookup table, then command if values equalvalues in lookup table. We can start with a pose, and predict thegesture by beginning to move in the direction of the final pose. As wecontinue to move, we would be scrolling through a list of predictedgestures until we can find the most probable desired gesture, causingthe command of the gesture to be triggered before the gesture iscompleted. Predicted gestures could be dynamically shown in a list ofchoices and represented by objects or text or colors or by some othermeans in a display. As we continue to move, predicted end results ofgestures would be dynamically displayed and located in such a place thatonce the correct one appears, movement towards that object, representingthe correct gesture, would select and activate the gestural command. Inthis way, a gesture could be predicted and executed before the totalityof the gesture is completed, increasing speed and providing morevariables for the user.

For example, in a keyboard application, current software use shapes ofgestures to predict words. Google uses zones of letters (a group ofletters), and combinations of zones (gestures) to predict words. Wewould use the same gesture-based system, except we be able to predictwhich zone the user is moving towards based upon direction of motion,meaning we would not have to actually move into the zone to finish thegesture, but moving towards the zone would select or bring up choicebubbles, and moving towards the bubble would select that bubble. Once aword is chose, a menu of expanding option could show, so one couldcreate a sentence by moving through a sentence “tree”.

In another example, instead of using a gesture such as “a pinch” gestureto select something in a touchless environment, movement towards makingthat gesture would actually trigger the same command. So instead ofhaving to actually touch the finger to the thumb, just moving the fingertowards the thumb would cause the same effect to occur. Most helpful incombination gestures where a finger pointing gesture is followed by apinching gesture to then move a virtual object. By predicting thegesture, after the point gesture, the beginning movement of the pinchgesture would be faster than having to finalize the pinching motion.

Other embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of: sensing movement via amotion sensor within a display field displaying a list of letters froman alphabet, predicting a letter or a group of letters based on themotion, if movement is aligned with a single letter, simultaneouslyselect the letter or simultaneously moving the group of letter forwarduntil a discrimination between letters in the group is predictivelycertain and simultaneously select the letter, sensing a change in adirection of motion, predicting a second letter or a second group ofletter based on the motion, if movement is aligned with a single letter,simultaneously select the letter or simultaneously moving the group ofletter forward until a discrimination between letters in the group ispredictively certain and simultaneously select the letter, either afterthe first letter selection or the second letter selection or both,display a list of potential words beginning with either the first letteror the second letter, selecting a word from the word list by movement ofa second body part simultaneously selected the word and resetting theoriginal letter display, and repeating the steps until a message iscompleted.

Thus, the current design selects a letter simply by changing a directionof movement at or near a letter. A faster process would be to usemovement toward a letter, then changing a direction of movement beforereaching the letter and moving towards a next letter and changingdirection of movement again before getting to the next letter wouldbetter predict words, and might change the first letter selection.Selection bubbles would appear and be changing while moving, so speedand direction would be used to predict the word, not necessarily havingto move over the exact letter or very close to it, though moving overthe exact letter would be a positive selection of that letter and thiseffect could be better verified by a slight pausing or slowing down ofmovement. (Of course, this could be combined with current button likeactions or lift-off events (touch-up events), and more than one fingeror hand may be used, both simultaneously or sequentially to provide thespelling and typing actions.) This is most effective in a touchlessenvironment where relative motion can be leveraged to predict words on akeyboard rather than the actual distance required to move from key tokey. The distance from a projected keyboard and movement of finger usesangles of motion to predict letters. Predictive word bubbles can beselected with a Z movement. B) Move below the letters of a keyboard toselect, or shape the letter buttons in such a way that they extenddownward (like a tear drop) so actual letters can be seen whileselecting instead of covering the letters (the touch or active zones areoffset from the actual keys. This can also be used with predictivemotions to create a very fast keyboard where relative motions are usedto predict keys and words while more easily being able to see the keyletters. Bubbles could also appear above or besides the keys, or aroundthem, including in an arcuate or radial fashion to further selectpredicted results by moving towards the suggested words.

Other embodiments of this invention relate to methods and systems forimplementing the methods comprising the steps of: maintaining allsoftware applications in an instant on configuration on, but inactive,resident, but not active, so that once selected the application which ismerely dormant, is fully activate instantaneously (or may be describedas a different focus of the object), sensing movement via a motionsensor with a display field including application objects distributed onthe display in a spaced apart configuration, preferably, in a maximallyspaced apart configuration so that the movement results in a fastpredict selection of an application object, pulling an applicationobject or a group of application objects toward a center of the displayfield, if movement is aligned with a single application, simultaneouslyselect and instant on the application, or continue monitoring themovement until a discrimination between application objects ispredictively certain and simultaneously selecting and activating theapplication object.

Thus, the industry must begin to start looking at everything as alwayson and what is on is always interactive, and may have different levelsof interactivity. For instance, software should be an interactive field.Excel and word should be interactive fields where motion through themcan combine or select areas, which correspond to cells and texts beingintertwined with the motion. Excel sheets should be part of the same 3Dfield, not separate pages, and should have depth so their aspects can becombined in volume. The software desktop experience needs a depth wherethe desktop is the cover of a volume, and rolling back the desktop fromdifferent corners reveals different programs that are active and havedifferent colors, such as word being revealed when moving from bottomright to top left and being a blue field, excel being revealed whenmoving from top left to bottom right and being red; moving right to leftlifts desktop cover and reveals all applications in volume, eachapplication with its own field and color in 3D space.

Other embodiments of this invention relate to methods and systems ofthis invention, where the active screen area includes a delete orbackspace region. When the user moves the active object (cursor) towardthe delete or backspace region, then the selected objects will bereleased one at a time or in groups or completely depending onattributes of movement toward the delete of backspace region. Thus, ifthe movement is slow and steady, then the selected objects are releasedone at a time. If the movement is fast, then multiple selected objectsare released. Thus, the delete or backspace region is variable. Forexample, if the active display region represents a cell phone dialingpad (with the number distributed in any desired configuration from atraditional grid configuration to a arcuate configuration about theactive object, or in any other desirable configuration), when by movingthe active object toward the delete or backspace region, numbers will beremoved from the number, which may be displayed in a number displayregion of the display. Alternatively, touching the backspace regionwould back up one letter; moving from right to left in the backspaceregion would delete (backspace) a corresponding amount of letters basedon the distance (and/or speed) of the movement, The deletion could occurwhen the motion is stopped, paused, or a lift off event is detected.Alternatively, a swiping motion (jerk, or fast acceleration) couldresult in the deletion (backspace) the entire word. All these may or maynot require a lift off event, but the motion dictates the amount deletedor released objects such as letters, numbers, or other types of objects.The same is true with the delete key, except the direction would beforward instead of backwards. Lastly, the same could be true in a radialmenu (or linear or spatial), where the initial direction of motiontowards an object or on an object, or in a zone associated with anobject, that has a variable attribute. The motion associated with ortowards that object would provide immediate control.

Other embodiments of this invention relate to methods and systems ofthis invention, where eye movement is used to select and body partmovement is used to confirm or activate the selection. Thus, eyemovement is used as the selective movement, while the object remains inthe selected state, then the body part movement confirms the selectionand activates the selected object. Thus, specifically stated the eye oreyes look in a different direction or area, and the last selected objectwould remain selected until a different object is selected by motion ofthe eyes or body, or until a time-out deselects the object. An objectmay be also selected by an eye gaze, and this selection would continueeven when the eye or eyes are no longer looking at the object. Theobject would remain selected unless a different selectable object islooked at, or unless a timeout deselects the object occurs.

In all of the embodiments set forth above, the motion or movement mayalso comprise lift off events, where a finger or other body part orparts are in direct contract with a touch sensitive feedback device suchas a touch screen, then the acceptable forms of motion or movement willcomprise touching the screen, moving on or across the screen, liftingoff from the screen (lift off events), holding still on the screen at aparticular location, holding still after first contact, holding stillafter scroll commencement, holding still after attribute adjustment tocontinue an particular adjustment, holding still for different periodsof time, moving fast or slow, moving fast or slow or different periodsof time, accelerating or decelerating, accelerating or decelerating fordifferent periods of time, changing direction, changing speed, changingvelocity, changing acceleration, changing direction for differentperiods of time, changing speed for different periods of time, changingvelocity for different periods of time, changing acceleration fordifferent periods of time, or any combinations of these motions may beused by the systems and methods to invoke command and control over realworld or virtual world controllable objects using on the motion only.Lift off or other events could “freeze” the state of menu, object orattribute selection, or combination of these, until another event occursto move to a different event or state, or a time-out function resets thesystem or application to a preconfigured state or location. A virtuallift off could accomplish the same effect in a VR, AR or realenvironment, by moving in a different direction or designated directionwith no physical lift off event. Of course, if certain objects that areinvoked by the motion sensitive processing of the systems and methods ofthis invention require hard select protocols mouse clicks, fingertouches, etc., the invoked object's internal function will not beaugmented by the systems or methods of this invention unless the invokedobject permits or supports system integration. In place of physical orvirtual lift offs or confirmations could be sounds, colors or contextualor environmental triggers.

The systems and methods are disclosed herein where command functions forselection and/or control of real and/or virtual objects may be generatedbased on a change in velocity at constant direction, a change indirection at constant velocity, a change in both direction and velocity,a change in a rate of velocity, or a change in a rate of acceleration.Once detected by an detector or sensor, these changes may be used by aprocessing unit to issue commands for controlling real and/or virtualobjects. A selection or combination scroll, selection, and attributeselection may occur upon the first movement. Such motion may beassociated with doors opening and closing in any direction, golf swings,virtual or real world games, light moving ahead of a runner, but stayingwith a walker, or any other motion having compound properties such asdirection, velocity, acceleration, and changes in any one or all ofthese primary properties; thus, direction, velocity, and accelerationmay be considered primary motion properties, while changes in theseprimary properties may be considered secondary motion properties. Thesystem may then be capable of differentially handling of primary andsecondary motion properties. Thus, the primary properties may causeprimary functions to be issued, while secondary properties may causeprimary function to be issued, but may also cause the modification ofprimary function and/or secondary functions to be issued. For example,if a primary function comprises a predetermined selection format, thesecondary motion properties may expand or contract the selection format.

In another example of this primary/secondary format for causing thesystem to generate command functions may involve an object display.Thus, by moving the object in a direction away from the user's eyes, thestate of the display may change, such as from a graphic to a combinationgraphic and text, to a text display only, while moving side to side ormoving a finger or eyes from side to side could scroll the displayedobjects or change the font or graphic size, while moving the head to adifferent position in space might reveal or control attributes orsubmenus of the object. Thus, these changes in motions may be discrete,compounded, or include changes in velocity, acceleration and rates ofthese changes to provide different results for the user. These examplesillustrate two concepts: 1) the ability to have compound motions whichprovide different results that the motions separately or sequentially,and (2) the ability to change states or attributes, such as graphics totext solely or in combination with single or compound motions, or withmultiple inputs, such as verbal, touch, facial expressions, orbio-kinetically, all working together to give different results, or toprovide the same results in different ways.

It must be recognized that the present invention while based on the useof sensed velocity, acceleration, and changes and rates of changes inthese properties to effect control of real world objects and/or virtualobjects, the present invention may also use other properties of thesensed motion in combination with sensed velocity, acceleration, andchanges in these properties to effect control of real world and/orvirtual objects, where the other properties include direction and changein direction of motion, where the motion has a constant velocity. Forexample, if the motion sensor(s) senses velocity, acceleration, changesin velocity, changes in acceleration, and/or combinations thereof thatis used for primary control of the objects via motion of a primarysensed human, animal, part thereof, real world object under the controlof a human or animal, or robots under control of the human or animal,then sensing motion of a second body part may be used to confirm primaryselection protocols or may be used to fine tune the selected command andcontrol function. Thus, if the selection is for a group of objects, thenthe secondary motion properties may be used to differentially controlobject attributes to achieve a desired final state of the objects.

For example, suppose the apparatuses of this invention control lightingin a building. There are banks of lights on or in all four walls(recessed or mounted) and on or in the ceiling (recessed or mounted).The user has already selected and activated lights from a selection menuusing motion to activate the apparatus and motion to select and activatethe lights from a list of selectable menu items such as sound system,lights, cameras, video system, etc. Now that lights has been selectedfrom the menu, movement to the right would select and activate thelights on the right wall. Movement straight down would turn all of thelights of the right wall down dim the lights. Movement straight up wouldturn all of the lights on the right wall up brighten. The velocity ofthe movement down or up would control the rate that the lights weredimmed or brighten. Stopping movement would stop the adjustment orremoving the body, body part or object under the user control within themotion sensing area would stop the adjustment.

For even more sophisticated control using motion properties, the usermay move within the motion sensor active area to map out a downwardconcave arc, which would cause the lights on the right wall to dimproportionally to the arc distance from the lights. Thus, the rightlights would be more dimmed in the center of the wall and less dimmedtoward the ends of the wall.

Alternatively, if the movement was convex downward, then the light woulddim with the center being dimmed the least and the ends the most.Concave up and convex up would cause differential brightening of thelights in accord with the nature of the curve.

Now, the apparatus may also use the velocity of the movement of themapping out the concave or convex movement to further change the dimmingor brightening of the lights. Using velocity, starting off slowly andincreasing speed in a downward motion would cause the lights on the wallto be dimmed more as the motion moved down. Thus, the lights at one endof the wall would be dimmed less than the lights at the other end of thewall.

Now, suppose that the motion is a S-shape, then the light would bedimmed or brightened in a S-shaped configuration. Again, velocity may beused to change the amount of dimming or brightening in different lightssimply by changing the velocity of movement. Thus, by slowing themovement, those lights would be dimmed or brightened less than when themovement is speed up. By changing the rate of velocity accelerationfurther refinements of the lighting configuration may be obtained.

Now suppose that all the lights in the room have been selected, thencircular or spiral motion would permit the user to adjust all of thelights, with direction, velocity and acceleration properties being usedto dim and/or brighten all the lights in accord with the movementrelative to the lights in the room. For the ceiling lights, the circularmotion may move up or down in the z direction to affect the luminosityof the ceiling lights. Thus, through the sensing of motion or movementwithin an active sensor zone area and especially volume, a user can usesimple or complex motion to differentially control large numbers ofdevices simultaneously. By scrolling through the area (pointing thefinger at each light) and stopping motion at each light desired it wouldbe selected, then moving in a different direction would allow forattribute of only the selected lights. The same would hold for virtualobjects in a 2D or 3D (VR/AR) environment. Thus, a user is able toselect groups of objects that may represent real or virtual objects andonce the group is selected, movement of the user may adjust all objectand/or device attribute collectively. This feature is especially usefulwhen the interface is associated with a large number of object,subobjects, and/or devices and the user wants to selected groups ofthese objects, subobjects, and/or devices so that they may be controlledcollectively. Thus, the user may navigate through the objects,subobjects and/or devices and select any number of them by moving toeach object pausing so that the system recognizes to add the object tothe group. Once the group is defined, the user would be able to save thegroup as a predefined group or just leave it as a temporary group.Regardless, the group would not act as a single object for the remainderof the session. The group may be deselected by moving outside of theactive field of sensor, sensors, and/or sensor arrays.

This differential control through the use of sensed complex motionpermits a user to nearly instantaneously change lighting configurations,sound configurations, TV configurations, or any configuration of systemshaving a plurality of devices being simultaneously controlled or of asingle system having a plurality of objects or attributes capable ofsimultaneous control. For examples, in a computer game including largenumbers of virtual objects such as troops, tanks, airplanes, etc.,sensed complex motion would permit the user to quickly deploy, redeploy,rearrangement, manipulated and generally quickly reconfigure allcontrollable objects and/or attributes by simply conforming the movementof the objects to the movement of the user sensed by the motiondetector. This same differential device and/or object control would findutility in military and law enforcement, where command personnel bymotion or movement within a sensing zone of a motion sensor quicklydeploy, redeploy, rearrangement, manipulated and generally quicklyreconfigure all assets to address a rapidly changing situation.

Embodiments of systems of this invention include a motion sensor orsensor array, where each sensor includes an active zone and where eachsensor senses movement, movement direction, movement velocity, and/ormovement acceleration, and/or changes in movement direction, changes inmovement velocity, and/or changes in movement acceleration, and/orchanges in a rate of a change in direction, changes in a rate of achange in velocity and/or changes in a rate of a change in accelerationwithin the active zone by one or a plurality of body parts or objectsand produces an output signal. The systems also include at least oneprocessing unit including communication software and hardware, where theprocessing units convert the output signal or signals from the motionsensor or sensors into command and control functions, and one or aplurality of real objects and/or virtual objects in communication withthe processing units. The command and control functions comprise atleast (1) a scroll function or a plurality of scroll functions, (2) aselect function or a plurality of select functions, (3) an attributefunction or plurality of attribute functions, (4) an attribute controlfunction or a plurality of attribute control functions, or (5) asimultaneous control function. The simultaneous control functionincludes (a) a select function or a plurality of select functions and ascroll function or a plurality of scroll functions, (b) a selectfunction or a plurality of select functions and an activate function ora plurality of activate functions, and (c) a select function or aplurality of select functions and an attribute control function or aplurality of attribute control functions. The processing unit or units(1) processes a scroll function or a plurality of scroll functions, (2)selects and processes a scroll function or a plurality of scrollfunctions, (3) selects and activates an object or a plurality of objectsin communication with the processing unit, or (4) selects and activatesan attribute or a plurality of attributes associated with an object or aplurality of objects in communication with the processing unit or units,or any combination thereof. The objects comprise electrical devices,electrical systems, sensors, hardware devices, hardware systems,environmental devices and systems, energy and energy distributiondevices and systems, software systems, software programs, softwareobjects, or combinations thereof. The attributes comprise adjustableattributes associated with the devices, systems, programs and/orobjects. In certain embodiments, the sensor(s) is(are) capable ofdiscerning a change in movement, velocity and/or acceleration of +5%. Inother embodiments, the sensor(s) is(are) capable of discerning a changein movement, velocity and/or acceleration of +10°. In other embodiments,the system further comprising a remote control unit or remote controlsystem in communication with the processing unit to provide remotecontrol of the processing unit and all real and/or virtual objects underthe control of the processing unit. In other embodiments, the motionsensor is selected from the group consisting of digital cameras, opticalscanners, optical roller ball devices, touch pads, inductive pads,capacitive pads, holographic devices, laser tracking devices, thermaldevices, touch or touchless sensors, acoustic devices, any other devicecapable of sensing motion, fields, waveforms, or changes thereof, arraysof such devices, and mixtures and combinations thereof. In otherembodiments, the objects include environmental controls, lightingdevices, cameras, ovens, dishwashers, stoves, sound systems, displaysystems, alarm systems, control systems, virtual reality systems,augmented reality systems, medical devices, robots, robotic controlsystems, virtual reality systems, augmented reality systems, hot andcold water supply devices, air conditioning systems, heating systems,ventilation systems, air handling systems, computers and computersystems, chemical or manufacturing plant control systems, computeroperating systems and other software systems, remote control systems,mobile devices, electrical systems, sensors, hardware devices, hardwaresystems, environmental devices and systems, energy and energydistribution devices and systems, software programs or objects ormixtures and combinations thereof.

Embodiments of methods of this invention for controlling objects includethe step of sensing movement, movement direction, movement velocity,and/or movement acceleration, and/or changes in movement direction,changes in movement velocity, and/or changes in movement acceleration,and/or changes in a rate of a change in direction, changes in a rate ofa change in velocity and/or changes in a rate of a change inacceleration within the active zone by one or a plurality of body partsor objects within an active sensing zone of a motion sensor or withinactive sensing zones of an array of motion sensors. The methods alsoinclude the step of producing an output signal or a plurality of outputsignals from the sensor or sensors and converting the output signal orsignals into a command function or a plurality of command functions. Thecommand and control functions comprise at least (1) a scroll function ora plurality of scroll functions, (2) a select function or a plurality ofselect functions, (3) an attribute function or plurality of attributefunctions, (4) an attribute control function or a plurality of attributecontrol functions, or (5) a simultaneous control function. Thesimultaneous control function includes (a) a select function or aplurality of select functions and a scroll function or a plurality ofscroll functions, (b) a select function or a plurality of selectfunctions and an activate function or a plurality of activate functions,and (c) a select function or a plurality of select functions and anattribute control function or a plurality of attribute controlfunctions. In certain embodiments, the objects comprise electricaldevices, electrical systems, sensors, hardware devices, hardwaresystems, environmental devices and systems, energy and energydistribution devices and systems, software systems, software programs,software objects, or combinations thereof. In other embodiments, theattributes comprise adjustable attributes associated with the devices,systems, programs and/or objects. In other embodiments, the timed holdis brief or the brief cessation of movement causing the attribute to beadjusted to a preset level, causing a selection to be made, causing ascroll function to be implemented, or a combination thereof. In otherembodiments, the timed hold is continued causing the attribute toundergo a high value/low value cycle that ends when the hold is removed.In other embodiments, the timed hold causes an attribute value to changeso that (1) if the attribute is at its maximum value, the timed holdcauses the attribute value to decrease at a predetermined rate, untilthe timed hold is removed, (2) if the attribute value is at its minimumvalue, then the timed hold causes the attribute value to increase at apredetermined rate, until the timed hold is removed, (3) if theattribute value is not the maximum or minimum value, then the timed holdcauses randomly selects the rate and direction of attribute value changeor changes the attribute to allow maximum control, or (4) the timed holdcauses a continuous change in the attribute value or scroll function ina direction of the initial motion until the timed hold is removed. Inother embodiments, the motion sensor is selected from the groupconsisting of sensors of any kind including digital cameras, opticalscanners, optical roller ball devices, touch pads, inductive pads,capacitive pads, holographic devices, laser tracking devices, thermaldevices, touch or touchless sensors, acoustic devices, and any otherdevice capable of sensing motion or changes in any waveform due tomotion or arrays of such devices, and mixtures and combinations thereof.In other embodiments, the objects include lighting devices, cameras,ovens, dishwashers, stoves, sound systems, display systems, alarmsystems, virtual reality systems, augmented reality systems, controlsystems, virtual reality systems, augmented reality systems, medicaldevices, robots, robotic control systems, hot and cold water supplydevices, air conditioning systems, heating systems, ventilation systems,air handling systems, computers and computer systems, chemical plantcontrol systems, computer operating systems and other software systems,remote control systems, sensors, or mixtures and combinations thereof.

The all of these scenarios set forth above are designed to illustratethe control of a large number of devices using properties and/orcharacteristics of the sensed motion including, without limitation,relative distance of the motion for each object (real like a person in aroom using his/her hand as the object for which motion is being sensedor virtual representations of the objects in a virtual or rendered roomon a display apparatus), direction of motion, speed of motion,acceleration of motion, changes an any of these properties, rates ofchanges in any of these properties, or mixtures and combinations thereofto control a single controllable attribute of the object such as lights.However, the systems, apparatuses, and methods of this invention arealso capable of using motion properties and/or characteristics tocontrol two, three, or more attributes of an object. Additionally, thesystems, apparatuses, and methods of this invention are also capable ofusing motion properties and/or characteristics from a plurality ofmoving objects within a motion sensing zone to control differentattributes of a collection of objects. For example, if the lights in theabove figures are capable of color as well as brighten, then the motionproperties and/or characteristic may be used to simultaneously changecolor and intensity of the lights or one sensed motion could controlintensity, while another sensed motion could control color. For example,if an artist wanted to paint a picture on a computer generated canvas,then motion properties and/or characteristic would allow the artist tocontrol the pixel properties of each pixel on the display using theproperties of the sensed motion from one, two, three, etc. sensedmotions. Thus, the systems, apparatuses, and methods of this inventionare capable of converting the motion properties associated with each andevery object being controlled based on the instantaneous propertiesvalues as the motion traverse the object in real space or virtual space.

The systems, apparatuses and methods of this invention activate uponmotion being sensed by one or more motion sensors. This sensed motionthen activates the systems and apparatuses causing the systems andapparatuses to process the motion and its properties activating aselection object and a plurality of selectable objects. Once activated,the motion properties cause movement of the selection objectaccordingly, which will cause a pre-selected object or a group ofpre-selected objects, to move toward the selection object, where thepre-selected object or the group of pre-selected objects are theselectable object(s) that are most closely aligned with the direction ofmotion, which may be evidenced by the user feedback units bycorresponding motion of the selection object. Another aspect of thesystems or apparatuses of this invention is that the faster theselection object moves toward the pre-selected object or the group ofpreselected objects, the faster the pre-selected object or the group ofpreselected objects move toward the selection object. Another aspect ofthe systems or apparatuses of this invention is that as the pre-selectedobject or the group of pre-selected objects move toward the selectionobject, the pre-selected object or the group of pre-selected objects mayincrease in size, change color, become highlighted, provide other formsof feedback, or a combination thereof. Another aspect of the systems orapparatuses of this invention is that movement away from the objects orgroups of objects may result in the objects moving away at a greater oraccelerated speed from the selection object(s). Another aspect of thesystems or apparatuses of this invention is that as motion continues,the motion will start to discriminate between members of the group ofpre-selected object(s) until the motion results in the selection of asingle selectable object or a coupled group of selectable objects. Oncethe selection object and the target selectable object touch, activeareas surrounding the objection touch, a threshold distance between theobject is achieved, or a probability of selection exceeds an activationthreshold, the target object is selected and non-selected displayobjects are removed from the display, change color or shape, or fadeaway or any such attribute so as to recognize them as not selected. Thesystems or apparatuses of this invention may center the selected objectin a center of the user feedback unit or center the selected object ator near a location where the motion was first sensed. The selectedobject maybe in a corner of a display—on the side the thumb is on whenusing a phone, and the next level menu is displayed slightly furtheraway, from the selected object, possibly arcuately, so the next motionis close to the first, usually working the user back and forth in thegeneral area of the center of the display. If the object is anexecutable object such as taking a photo, turning on a device, etc, thenthe execution is simultaneous with selection. If the object is asubmenu, sublist or list of attributes associated with the selectedobject, then the submenu members, sublist members or attributes aredisplayed on the screen in a spaced apart format. The same procedureused to select the selected object is then used to select a member ofthe submenu, sublist or attribute list. Thus, the interfaces have agravity like or anti-gravity like action on display objects. As theselection object(s) moves, it attracts an object or objects in alignmentwith the direction of the selection object's motion pulling thoseobject(s) toward it and may simultaneously or sequentially repelnon-selected items away or indicate non-selection in any other manner soas to discriminate between selected and non-selected objects As motioncontinues, the pull increases on the object most aligned with thedirection of motion, further accelerating the object toward theselection object until they touch or merge or reach a threshold distancedetermined as an activation threshold. The touch or merge or thresholdvalue being reached causes the processing unit to select and activatethe object(s). Additionally, the sensed motion may be one or moremotions detected by one or more movements within the active zones of themotion sensor(s) giving rise to multiple sensed motions and multiplecommand function that may be invoked simultaneously or sequentially. Thesensors may be arrayed to form sensor arrays. If the object is anexecutable object such as taking a photo, turning on a device, etc, thenthe execution is simultaneous with selection. If the object is asubmenu, sublist or list of attributes associated with the selectedobject, then the submenu members, sublist members or attributes aredisplayed on the screen in a spaced apart format. The same procedureused to select the selected object is then used to select a member ofthe submenu, sublist or attribute list. Thus, the interfaces have agravity like action on display objects. As the selection object moves,it attracts an object or objects in alignment with the direction of theselection object's motion pulling those object toward it. As motioncontinues, the pull increases on the object most aligned with thedirection of motion, further accelerating the object toward theselection object until they touch or merge or reach a threshold distancedetermined as an activation threshold to make a selection. The touch,merge or threshold event causes the processing unit to select andactivate the object.

The sensed motion may result not only in activation of the systems orapparatuses of this invention, but may be result in select, attributecontrol, activation, actuation, scroll or combination thereof.

Different haptic (tactile) or audio or other feedback may be used toindicate different choices to the user, and these may be variable inintensity as motions are made. For example, if the user moving throughradial zones different objects may produce different buzzes or sounds,and the intensity or pitch may change while moving in that zone toindicate whether the object is in front of or behind the user.

Compound motions may also be used so as to provide different controlfunction than the motions made separately or sequentially. This includescombination attributes and changes of both state and attribute, such astilting the device to see graphics, graphics and text or text, alongwith changing scale based on the state of the objects, while providingother controls simultaneously or independently, such as scrolling,zooming in/out, or selecting while changing state. These features mayalso be used to control chemicals being added to a vessel, whilesimultaneously controlling the amount. These features may also be usedto change between Windows 8 and Windows 7 with a tilt while moving iconsor scrolling through programs at the same time.

Audible or other communication medium may be used to confirm objectselection or in conjunction with motion so as to provide desiredcommands (multimodal) or to provide the same control commands indifferent ways.

The present systems, apparatuses, and methods may also includeartificial intelligence components that learn from user motioncharacteristics, environment characteristics (e.g., motion sensor types,processing unit types, or other environment properties), controllableobject environment, etc. to improve or anticipate object selectionresponses.

Embodiments of this invention further relate to systems for selectingand activating virtual or real objects and their controllable attributesincluding at least one motion sensor having an active sensing zone, atleast one processing unit, at least one power supply unit, and oneobject or a plurality of objects under the control of the processingunits. The sensors, processing units, and power supply units are inelectrical communication with each other. The motion sensors sensemotion including motion properties within the active zones, generate atleast one output signal, and send the output signals to the processingunits. The processing units convert the output signals into at least onecommand function. The command functions include (1) a start function,(2) a scroll function, (3) a select function, (4) an attribute function,(5) an attribute control function, (6) a simultaneous control functionincluding: (a) a select and scroll function, (b) a select, scroll andactivate function, (c) a select, scroll, activate, and attribute controlfunction, (d) a select and activate function, (e) a select and attributecontrol function, (f) a select, active, and attribute control function,or (g) combinations thereof, or (7) combinations thereof. The startfunctions activate at least one selection or cursor object and aplurality of selectable objects upon first sensing motion by the motionsensors and selectable objects aligned with the motion direction movetoward the selection object or become differentiated from non-alignedselectable objects and motion continues until a target selectable objector a plurality of target selectable objects are discriminated fromnon-target selectable objects resulting in activation of the targetobject or objects. The motion properties include a touch, a lift off, adirection, a velocity, an acceleration, a change in direction, a changein velocity, a change in acceleration, a rate of change of direction, arate of change of velocity, a rate of change of acceleration, stops,holds, timed holds, or mixtures and combinations thereof. The objectscomprise real world objects, virtual objects and mixtures orcombinations thereof, where the real world objects include physical,mechanical, electro-mechanical, magnetic, electro-magnetic, electrical,or electronic devices or any other real world device that can becontrolled by a processing unit and the virtual objects include anyconstruct generated in a virtual world or by a computer and displayed bya display device and that are capable of being controlled by aprocessing unit. The attributes comprise activatable, executable and/oradjustable attributes associated with the objects. The changes in motionproperties are changes discernible by the motion sensors sensor outputs,and/or the processing units.

In certain embodiments, the start functions further activate the userfeedback units and the selection objects and the selectable objects arediscernible via the motion sensors in response to movement of an animal,human, robot, robotic system, part or parts thereof, or combinationsthereof within the motion sensor active zones. In other embodiments, thesystem further includes at least on user feedback unit, at least onebattery backup unit, communication hardware and software, at least oneremote control unit, or mixtures and combinations thereof, where thesensors, processing units, power supply units, the user feedback units,the battery backup units, the remote control units are in electricalcommunication with each other. In other embodiments, faster motioncauses a faster movement of the target object or objects toward theselection object or causes a greater differentiation of the targetobject or object from the non-target object or objects. In otherembodiments, if the activated objects or objects have subobjects and/orattributes associated therewith, then as the objects move toward theselection object, the subobjects and/or attributes appear and becomemore discernible as object selection becomes more certain. In otherembodiments, once the target object or objects have been selected, thenfurther motion within the active zones of the motion sensors causesselectable subobjects or selectable attributes aligned with the motiondirection to move towards the selection object(s) or becomedifferentiated from non-aligned selectable subobjects or selectableattributes and motion continues until a target selectable subobject orattribute or a plurality of target selectable objects and/or attributesare discriminated from non-target selectable subobjects and/orattributes resulting in activation of the target subobject, attribute,subobjects, or attributes. In other embodiments, the motion sensor isselected from the group consisting of digital cameras, optical scanners,optical roller ball devices, touch pads, inductive pads, capacitivepads, holographic devices, laser tracking devices, thermal devices,acoustic devices, any other device capable of sensing motion, arrays ofmotion sensors, and mixtures or combinations thereof. In otherembodiments, the objects include lighting devices, cameras, ovens,dishwashers, stoves, sound systems, display systems, alarm systems,control systems, medical devices, robots, robotic control systems, hotand cold water supply devices, air conditioning systems, heatingsystems, ventilation systems, air handling systems, computers andcomputer systems, chemical plant control systems, computer operatingsystems, virtual reality systems, augmented reality systems, graphicssystems, business software systems, word processor systems, internetbrowsers, accounting systems, military systems, control systems, othersoftware systems, programs, routines, objects and/or elements, remotecontrol systems, or mixtures and combinations thereof. In otherembodiments, if the timed hold is brief, then the processing unit causesan attribute to be adjusted to a preset level. In other embodiments, ifthe timed hold is continued, then the processing unit causes anattribute to undergo a high value/low value cycle that ends when thehold is removed. In other embodiments, the timed hold causes anattribute value to change so that (1) if the attribute is at its maximumvalue, the timed hold causes the attribute value to decrease at apredetermined rate, until the timed hold is removed, (2) if theattribute value is at its minimum value, then the timed hold causes theattribute value to increase at a predetermined rate, until the timedhold is removed, (3) if the attribute value is not the maximum orminimum value, then the timed hold causes randomly selects the rate anddirection of attribute value change or changes the attribute to allowmaximum control, or (4) the timed hold causes a continuous change in theattribute value in a direction of the initial motion until the timedhold is removed. In other embodiments, the motion sensors sense a secondmotion including second motion properties within the active zones,generate at least one output signal, and send the output signals to theprocessing units, and the processing units convert the output signalsinto a confirmation command confirming the selection or at least onesecond command function for controlling different objects or differentobject attributes. In other embodiments, the motion sensors sensemotions including motion properties of two or more animals, humans,robots, or parts thereof, or objects under the control of humans,animals, and/or robots within the active zones, generate output signalscorresponding to the motions, and send the output signals to theprocessing units, and the processing units convert the output signalsinto command function or confirmation commands or combinations thereofimplemented simultaneously or sequentially, where the start functionsactivate a plurality of selection or cursor objects and a plurality ofselectable objects upon first sensing motion by the motion sensor andselectable objects aligned with the motion directions move toward theselection objects or become differentiated from non-aligned selectableobjects and the motions continue until target selectable objects orpluralities of target selectable objects are discriminated fromnon-target selectable objects resulting in activation of the targetobjects and the confirmation commands confirm the selections.

Embodiments of this invention further relates to methods for controllingobjects include sensing motion including motion properties within anactive sensing zone of at least one motion sensor, where the motionproperties include a direction, a velocity, an acceleration, a change indirection, a change in velocity, a change in acceleration, a rate ofchange of direction, a rate of change of velocity, a rate of change ofacceleration, stops, holds, timed holds, or mixtures and combinationsthereof and producing an output signal or a plurality of output signalscorresponding to the sensed motion. The methods also include convertingthe output signal or signals via a processing unit in communication withthe motion sensors into a command function or a plurality of commandfunctions. The command functions include (1) a start function, (2) ascroll function, (3) a select function, (4) an attribute function, (5)an attribute control function, (6) a simultaneous control functionincluding: (a) a select and scroll function, (b) a select, scroll andactivate function, (c) a select, scroll, activate, and attribute controlfunction, (d) a select and activate function, (e) a select and attributecontrol function, (f) a select, active, and attribute control function,or (g) combinations thereof, or (7) combinations thereof. The methodsalso include processing the command function or the command functionssimultaneously or sequentially, where the start functions activate atleast one selection or cursor object and a plurality of selectableobjects upon first sensing motion by the motion sensor and selectableobjects aligned with the motion direction move toward the selectionobject or become differentiated from non-aligned selectable objects andmotion continues until a target selectable object or a plurality oftarget selectable objects are discriminated from non-target selectableobjects resulting in activation of the target object or objects, wherethe motion properties include a touch, a lift off, a direction, avelocity, an acceleration, a change in direction, a change in velocity,a change in acceleration, a rate of change of direction, a rate ofchange of velocity, a rate of change of acceleration, stops, holds,timed holds, or mixtures and combinations thereof. The objects comprisereal world objects, virtual objects or mixtures and combinationsthereof, where the real world objects include physical, mechanical,electro-mechanical, magnetic, electro-magnetic, electrical, orelectronic devices or any other real world device that can be controlledby a processing unit and the virtual objects include any constructgenerated in a virtual world or by a computer and displayed by a displaydevice and that are capable of being controlled by a processing unit.The attributes comprise activatable, executable and/or adjustableattributes associated with the objects. The changes in motion propertiesare changes discernible by the motion sensors and/or the processingunits.

In certain embodiments, the motion sensor is selected from the groupconsisting of digital cameras, optical scanners, optical roller balldevices, touch pads, inductive pads, capacitive pads, holographicdevices, laser tracking devices, thermal devices, acoustic devices, anyother device capable of sensing motion, fields, waveforms, changesthereof, arrays of motion sensors, and mixtures or combinations thereof.In other embodiments, the objects include lighting devices, cameras,ovens, dishwashers, stoves, sound systems, display systems, alarmsystems, control systems, medical devices, robots, robotic controlsystems, hot and cold water supply devices, air conditioning systems,heating systems, ventilation systems, air handling systems, computersand computer systems, chemical plant control systems, computer operatingsystems, systems, graphics systems, business software systems, wordprocessor systems, internet browsers, accounting systems, militarysystems, control systems, other software systems, programs, routines,objects and/or elements, remote control systems, or mixtures andcombinations thereof. In other embodiments, if the timed hold is brief,then the processing unit causes an attribute to be adjusted to a presetlevel. In other embodiments, if the timed hold is continued, then theprocessing unit causes an attribute to undergo a high value/low valuecycle that ends when the hold is removed. In other embodiments, thetimed hold causes an attribute value to change so that (1) if theattribute is at its maximum value, the timed hold causes the attributevalue to decrease at a predetermined rate, until the timed hold isremoved, (2) if the attribute value is at its minimum value, then thetimed hold causes the attribute value to increase at a predeterminedrate, until the timed hold is removed, (3) if the attribute value is notthe maximum or minimum value, then the timed hold causes randomlyselects the rate and direction of attribute value change or changes theattribute to allow maximum control, or (4) the timed hold causes acontinuous change in the attribute value in a direction of the initialmotion until the timed hold is removed. In other embodiments, themethods include sensing second motion including second motion propertieswithin the active sensing zone of the motion sensors, producing a secondoutput signal or a plurality of second output signals corresponding tothe second sensed motion, converting the second output signal or signalsvia the processing units in communication with the motion sensors into asecond command function or a plurality of second command functions, andconfirming the selection based on the second output signals, orprocessing the second command function or the second command functionsand moving selectable objects aligned with the second motion directiontoward the selection object or become differentiated from non-alignedselectable objects and motion continues until a second target selectableobject or a plurality of second target selectable objects arediscriminated from non-target second selectable objects resulting inactivation of the second target object or objects, where the motionproperties include a touch, a lift off, a direction, a velocity, anacceleration, a change in direction, a change in velocity, a change inacceleration, a rate of change of direction, a rate of change ofvelocity, a rate of change of acceleration, stops, holds, timed holds,or mixtures and combinations thereof. In other embodiments, the methodsinclude sensing motions including motion properties of two or moreanimals, humans, robots, or parts thereof within the active zones of themotion sensors, producing output signals corresponding to the motions,converting the output signals into command function or confirmationcommands or combinations thereof, where the start functions activate aplurality of selection or cursor objects and a plurality of selectableobjects upon first sensing motion by the motion sensor and selectableobjects aligned with the motion directions move toward the selectionobjects or become differentiated from non-aligned selectable objects andthe motions continue until target selectable objects or pluralities oftarget selectable objects are discriminated from non-target selectableobjects resulting in activation of the target objects and theconfirmation commands confirm the selections.

Dynamic Environments

The inventors have found that systems and methods implemented on aprocessing unit such as a computer maybe constructed that permit thecreation of dynamic environments for object and/or attribute display,manipulation, differentiation, and/or interaction, where the systemsinclude one processing unit or a plurality of processing units, onemotion sensor or a plurality of motion sensors, one user interface or aplurality of user interfaces and dynamic environment software forgenerating, displaying, and manipulating the dynamic environments andthe objects and/or attributes included therein. The dynamic environmentsare produced via user interaction with the sensor(s), which are inelectronic communication with the processing unit(s), and comprise a setof objects and associated attributes displayed on the user interface(s)so that the objects and/or attributes are differentiated one from theother. The differentiation may evidence priority, directionality,content, type, activation procedures, activation parameters, controlfeatures, other properties that are associated with the objects and/orattributes or combinations thereof. The differentiation and distributionof the objects and/or attributes may change based on user interactionwith the motion sensors and/or locations of the motion sensors, where atleast one motion sensor or sensor output is associated with a mobile orstationary device or where at least one motion sensor or sensor outputis associated with a mobile device and at least one motion sensor orsensor output is associated with a stationary device, and mixtures orcombinations thereof. Of course, these same procedures may be used withobjects and/or attributes at any level of drill down.

In certain embodiments, the systems and methods of this inventionactivation of the system causes a plurality of selectable objects to bedisplayed on a display device of a user interface associated with thesystems. The selectable objects may be represent: (1) objects that maydirectly invoked, (2) objects that have a single attribute, (3) objectsthat have a plurality of attributes, (4) objects that are lists or menusthat may include sublists or submenus, (5) any other selectable item, or(6) mixtures and combinations thereof. The objects may represent virtualor real objects. Virtual objects may be any object that represents aninternal software component. Real object may be executable programs orsoftware application or may be real world devices that may be controlledby the systems and/or methods. The displayed selectable objects may be adefault set of selectable objects, pre-defined set of selectableobjects, or a dynamically generated set of selectable objects, generatedbased on locations of the sensors associated with mobile devices and themotion sensors associated with stationary devices. The systems andmethods permit the selectable objects to interact with the userdynamically so that object motion within the environments bettercorrelates with the user ability to interact with the objects. The userinteractions include, but are not limited to: (a) object discriminationbased on sensed motion, (b) object selection base on sensed motion, (c)menu drill down based on sensed motion, (d) menu drill up based onsensed motion, (e) object selection and activation based on sensedmotion and on the nature of the selectable object, (f)scroll/selection/activation based on sensed motion and on the nature ofthe selectable object, and (g) any combination of the afore listedinteractions associated with a collection of linked objects, where thelinking may be pre-defined, based on user gained interaction knowledge,or dynamically generated based on the user, sensor locations, and thenature of the sensed motion. The systems and methods may also associateone or a plurality of object differentiation properties with thedisplayed selectable objects, where the nature of the differentiationfor each object may be predefined, defined based on user gainedinteraction knowledge, or dynamically generated based on the user,sensor locations, and/or the nature of the sensed motion. Thedifferentiation properties include, but are not limited to: color; colorshading; spectral attributes associated with the shading; highlighting;flashing; rate of flashing; flickering; rate of flickering; shape; size;movement of the objects such as oscillation, side to side motion, up anddown motion, in and out motion, circular motion, elliptical motion,zooming in and out, etc.; rate of motion; pulsating; rate of pulsating;visual texture; touch texture; sounds such as tones, squeals, beeps,chirps, music, etc.; changes of the sounds; rate of changes in thesounds; any user discernible object differentiation properties, or anymixture and combination thereof. The differentiation may signify to theuser a sense of direction, object priority, object sensitivity, etc.,all helpful to the user for dynamic differentiation of selectableobjects displayed on the display derived from the user, sensed motion,and/or the location of the mobile and stationary sensors.

For example, one displayed object may pulsate (slight zooming in andout, or expanding and contracting) at a first rate, while anotherdisplayed object may pulsate a second rate, where the first and secondrates may be the same or different, and a faster pulsation rate may beassociated with a sense of urgency relative to objects having a slowerrate of pulsation. These rates may change in a pre-defined manner, amanner based on knowledge of the user, or dynamically based on the user,sensor locations, and/or the nature of the sensed motion.

In another example, a set of objects may slightly move to the rightfaster than they move back to the left, indicating that the user shouldapproach the objects from the right, instead from another direction.

In certain embodiments, a main object may have one or a plurality ofsub-objects moving (constant or variable rate and/or direction) aroundor near the main object, indicating the nature of the sub-objects. Inthis case, sub-objects revolving around the main object may representthat they need to be interacted with in a dynamic, motion-based way,whereas the main object may be interacted with in a static manner suchas a vocal command, hitting a button, clicking, or by any othernon-dynamic or static interaction.

In other embodiments, a main object may have a certain color, such asblue, and its associated sub-objects have shades of blue, especiallywhere the sub-objects dynamically transition from blue to off-blue orblue-green or other related colors, displaying they come from theprimary blue object, whereas a red Object next to the blue one mighthave sub-objects that transition to orange, while a sub-object thattransitions to purple might represent it is a sub-set of blue and redand can be accessed through either.

In other embodiments, the objects or sub-objects may fade in or out,representing changes of state based on a time period that the userinteracts with them. By fading out, the systems may be notifying theuser that the program or application (e.g., water flow in a building)will be entering a sleep or interruption state. The rate of the fade outmay indicate how quickly the program or application transitions into asleep state and how quickly they reactivate. A fade-in might relay theinformation that the object will automatically initiate over a giventime automatically vs. manually.

In other embodiments, an array of objects, such as the screen of apps ona mobile device, the objects pulsing might represent programs that areactive, whereas the objects that are static might represent programsthat are inactive. Programs that are pulsing at a slower rate mightrepresent programs running occasionally in the background. Of course,other dynamic indicators, such as changes in color, intensity,translucency, size, shape, or any recognizable attribute, may be used torelay information to the user.

Another example of the operation of the systems and methods of thisinvention may be in a medical context. In such a case, the objectsdisplayed on the user interface may be an array of sensors active in anoperating room including, but not limited to, oxygen sensors, blood flowsensors, pulse rate sensors, heart beat rate, blood pressure sensors,brain activity sensors, etc. The different dynamic changes in color,shape, size, sound, and/or movement of the objects may represent dataassociated with the sensors, providing multiple points of information ina simple, compounded way to the user. If color represented oxygen level,size represented pressure, and dynamic movement of the objectrepresented heartbeat, one object could represent a great deal ofinformation to the user.

The characteristics of associated sub-objects seen simultaneously (orsequentially after the primary objects are selected) could likewiseprovide much more information than just letting the user know moreinformation exists in this case, the primary object would be labeledwith the corresponding body position and the sub-object representingoxygen level past and current data might be pulsing or intensifyingdynamically in color, while the blood pressure sub-object might beslightly growing larger or smaller with each heartbeat, representingminimal change in blood pressure, and the heartbeat might be representedby the object rotating CW, then CCW with each heartbeat.

In another example, one object (or word in a word document) swappingplaces with another might represent the need to change the word toprovide better grammar for a sentence. Spelling changes might berepresented by pulsing words, and words that are acceptable, but have abetter common spelling might be represented by words that pulse at aslower rate. Dynamic changes of color might also be associated with thewords or other characteristics to draw attention to the user and givesecondary information at the same time, such as which words that mightbe too high or too low of a grade level for the reader in school books.

Thus, any combination of dynamic characteristics may be used to providemore information to the user than a static form of information, and maybe used in conjunction with the static information characteristic.

In certain embodiments, objects (such as application icons) may haveseveral possible states and display states. An object may be in anunselected state, a present state (available for selection but with noprobability of being selected yet), a pre-selected (now probable, butnot meeting a threshold criteria for being selected), a selected state(selected but not opened or having an execute command yet issued), or anactuated state (selected and having an attribute executed (i.e., on (vs.off), variable control ready to change based on moving up or down, or asubmenu is displayed and ready to be selected). If the object is in agroup of objects, as the user moves towards that group, the zone and/orthe group of objects may display or present a different characteristicthat represents they are ready to be selected; this may be identified asa pre-selected state. In each state, the objects may display differentcharacteristics to convey information to the user, such as change ofshape, size, color, sound, smell, feel, pulse rate, different dynamicdirectional animations, etc. For instance, before a user touches amobile device (one with a touch sensor), the objects may be in anunselected state, displaying no attribute other than the common staticdisplay currently employed. Once a user touches the screen, the itemsthat need attention might change in color (present, but no differentprobability of being selected than any others). As the user begins tomove in the direction of an object desired, the more likely objects maybegin to display differently, such as increasing in size, or beginpulsing, and as the probability increases, the pulse rate may increase,but objects in more urgent need of attention may pulse differently oreven faster than others in the same group or zone pre-selected. Once thecorrect object(s) is selected, it may show and even different state,such as displaying subobjects, changing color, or making a sound, but itstill may not be open or actuated yet. If the attribute is volumecontrol, it may be selected, but would not control volume until it isactuated by moving up or down, adjusting the volume. Of course, objectsin an unselected state may show dynamic characteristics (pulsing forexample) as well to convey information to the user, such as activity orpriority. In this way, it may have a dynamic characteristic while in astatic state.

In another example, for apps in the corner of a mobile device, when,head or eye gaze is directed towards that zone or objects, they may bein an unselected, preselected, or selected but not actuated state, andthey may demonstrate dynamic indicators/attributes to convey intent,attributes, sub-attributes, or mixed or combination content orattributes with changing environments. They may display differently atany state, or only at one particular state (such as selected), and thismay be a preset value, or something dynamic, such as contextual orenvironmental factors. An example of this last dynamic characteristicindicator would be in a vehicle or virtual reality display where thesong playlist would cause a pulsing effect on preferred songs, butdifferent songs would pulse differently when another occupant or playerenters the environment, indicating the suggested objects would changedue a combination of user preferences, and the dynamic displaycharacteristics of all or some of the objects would change to indicate acombination preferential selections).

The dynamic environment systems of this invention may also be used invirtual reality systems and/or augmented reality systems so that playersor users of these virtual reality systems and/or augmented realitysystems through motion and motion attributes are able to select, target,and/or deselect features, menus, objects, constructs, constructions,user attributes, weapons, personal attributes, personal features, anyother selectable or user definable features or attributes of the virtualspace or augmented reality space. Thus, as a user enters first enters avirtual reality space or augment reality space, all of the selectable ordefinable features and/or attributes of the space would be displayedabout the user in any desired form 2D and/or 3D semicircular orhemispherical array with user at center, 2D and/or 3D circular orspherical array with user at center, 2D and/or 3D matrix array with userat center or off-center, any other 2D and/or 3D display of features andattributes, or mixtures and combinations thereof. As the user moves abody part associated with the motion detectors used to interface withthe space (visual eye tracking sensors, hand part sensors gloves or thelike, body sensors body suits, or other sensors), the sensed motions andmotion attributes such as direction, speed, acceleration, and/or changesin any of these motion attributes cause features and/or attributes todisplay differently based on state and information to display to theuser, and may move toward the user based on the motion and motionproperties of the object and/or the user, while the other featuresand/or attributes stay static or move away from the user. An example ofthis is to move towards a particular tree in a group of trees in a game.As the user looks toward a particular tree, the tree might shake whilethe others sway gently, as the user moves toward the tree, the tree maybegin to move towards the user at a faster rate, if has a special prizeassociated with it, or at a slower rate in no prize. If the specialprize is a one of a kind attribute, the tree may change color or size atit moves towards the user and the user is moving towards the tree. Oncethe tree is selected via a threshold event, it may change shape into theprize it held, and then the start to act like that prize when it isselected by the user moving the hand towards a designated area of theobject enough to actuate. These different attributes or characteristicsare part of a dynamic environment where the speed, direction, state,display characteristics and attributes are affected by motion of theuser and object, or any combination of these. In another example, whereit is desired to choose one object, as the motion or motion attributesof user(s), object(s) or both continue, the features and/or attributesare further of user, objects or both are discriminated, and the targetfeatures and/or attributes may move closer. Once the target is fullydifferentiated, then all subfeatures and/or subobjects may becomevisible. As motion continues, features and/or attributes and/orsubfeatures and/or subobjects are selected and the user gains thecharacteristics or features the user desires in the space. All of thedisplayed features and/or attributes and/or subfeatures and/orsubobjects may also include highlighting features such as sound(chirping, beeping, singing, etc.), vibration, back and forth movement,up and down movement, circular movement, etc.

Motion Interfaces Using Different Data Types

Embodiments of this invention relate broadly to computing devices,comprising at least one sensor or sensor output configured to capturedata including user data, motion data, environment data, temporal data,contextual data, or mixtures and combinations thereof. The computingdevice also includes at least one processing unit configured, based onthe captured data, to generate at least one command function. Thecommand functions comprise: (1) a single control function including (a)a start function, (b) a scroll function, (c) a select function, (d) anattribute function, (e) an activate function, or (f) mixtures andcombinations thereof. The command functions also comprise: (2) asimultaneous control function including (a) a combination of two or moreof the functions (1a-1e), (b) a combination of three or more of thefunctions (1a-1e), (c) a combination of four or more of the functions(1a-1e), (d) mixtures and combinations thereof. The command functionsmay also comprise (3) mixtures and combinations of any of the abovefunctions. In certain embodiments, the at least one sensor comprisestouch pads, touchless pads, inductive sensors, capacitive sensors,optical sensors, acoustic sensors, thermal sensors, optoacousticsensors, electromagnetic field (EMF) sensors, wave or waveform sensors,strain gauges, accelerometers, any other sensor that senses movement orchanges in movement, or mixtures and combinations thereof. In otherembodiments, a first control function is a single control function. Inother embodiments, a first control function is a single control functionand a second function is a simultaneous control function. In otherembodiments, a first control function is a simultaneous controlfunction. In other embodiments, a first control function is asimultaneous control function and a second function is a simultaneouscontrol function. In other embodiments, a plurality of single andsimultaneous control functions are actuated by user determined motion.

Embodiments of this invention relate broadly to computer implementedmethods, comprising under the control of a processing unit configuredwith executable instructions, receiving data from at least one sensorconfigured to capture the data, where the captured data includes userdata, motion data, environment data, temporal data, contextual data, ormixtures and combinations thereof. The methods also comprise processingthe captured data to determine a type or types of the captured data;analyzing the type or types of the captured data; and invoking a controlfunction corresponding to the analyzed data. The control functionscomprise: (1) a single control function including: (a) a start function,(b) a scroll function, (c) a select function, (d) an attribute function,(e) an activate function, or (f) mixtures and combinations thereof, or(2) a simultaneous control function including: (a) a combination of twoor more of the functions (1a-1e), (b) a combination of three or more ofthe functions (1a-1e), (c) a combination of four or more of thefunctions (1a-1e), (d) mixtures and combinations thereof, or (3)mixtures and combinations thereof. In certain embodiments, the at leastone sensor comprises touch pads, touchless pads, inductive sensors,capacitive sensors, optical sensors, acoustic sensors, thermal sensors,optoacoustic sensors, electromagnetic field (EMF) sensors, straingauges, accelerometers, any other sensor that senses movement or changesin movement, or mixtures and combinations thereof. In other embodiments,a first control function is a single control function. In otherembodiments, a first control function is a single control function and asecond function is a simultaneous control function. In otherembodiments, a first control function is a simultaneous controlfunction. In other embodiments, a first control function is asimultaneous control function and a second function is a simultaneouscontrol function. In other embodiments, a plurality of single andsimultaneous control functions are actuated by user determined motion.

Embodiments of this invention relate broadly to non-transitory computerreadable storage media storing one or more sequences of instructionsthat, when executed by one or more processing units, cause a computingsystem to: (a) receive data from at least one sensor configured tocapture the data, where the captured data includes user data, motiondata, environment data, temporal data, contextual data, or mixtures andcombinations thereof; (b) process the captured data to determine a typeor types of the captured data; (c) analyze the type or types of thecaptured data; and (d) invoke a control function corresponding to theanalyzed data. The control functions comprise (1) a single controlfunction including: (a) a start function, (b) a scroll function, (c) aselect function, (d) an attribute function, (e) an activate function, or(f) mixtures and combinations thereof, or (2) a simultaneous controlfunction including: (a) a combination of two or more of the functions(1a-1e), (b) a combination of three or more of the functions (1a-1e),(c) a combination of four or more of the functions (1a-1e), (d) mixturesand combinations thereof, or (3) mixtures and combinations thereof. Incertain embodiments, the at least one sensor comprises touch pads,touchless pads, inductive sensors, capacitive sensors, optical sensors,acoustic sensors, thermal sensors, optoacoustic sensors, electromagneticfield (EMF) sensors, strain gauges, accelerometers, any other sensorthat senses movement or changes in movement, or mixtures andcombinations thereof. In other embodiments, a first control function isa single control function. In other embodiments, a first controlfunction is a single control function and a second function is asimultaneous control function. In other embodiments, a first controlfunction is a simultaneous control function. In other embodiments, afirst control function is a simultaneous control function and a secondfunction is a simultaneous control function. In other embodiments, aplurality of single and simultaneous control functions are actuated byuser determined motion.

Embodiments of this invention relate broadly to computer-implementedsystems comprising a digital processing device comprising at least oneprocessor, an operating system configured to perform executableinstructions, and a memory; a computer program including instructionsexecutable by the digital processing device to create a gesture-basednavigation environment. The environment comprises a software moduleconfigured to receive input data from a motion sensor, the input datarepresenting navigational gestures of a user; a software moduleconfigured to present one or more primary menu items; and a softwaremodule configured to present a plurality of secondary menu items inresponse to receipt of input data representing a navigational gesture ofthe user indicating selection of a primary menu item, the secondary menuitems arranged in a curvilinear orientation about the selected primarymenu item. The environment operates such that in response to receipt ofinput data representing a navigational gesture of the user comprisingmotion substantially parallel to the curvilinear orientation, theplurality of secondary menu items scrolls about the curvilinearorientation; in response to receipt of input data representing anavigational gesture of the user substantially perpendicular to thecurvilinear orientation, an intended secondary menu item in line withthe direction of the navigational gesture is scaled and moved oppositeto the direction of the navigational gesture to facilitate user access.In certain embodiments, the processing device or unit is a smart watchand the motion sensor is a touchscreen display.

Embodiments of this invention relate broadly to non-transitorycomputer-readable storage media encoded with a computer programincluding instructions executable by a processor to create agesture-based navigation environment comprising: a software moduleconfigured to receive input data from a motion sensor, the input datarepresenting navigational gestures of a user; a software moduleconfigured to present one or more primary menu items; and a softwaremodule configured to present a plurality of secondary menu items inresponse to receipt of input data representing a navigational gesture ofthe user indicating selection of a primary menu item, the secondary menuitems arranged in a curvilinear orientation about the selected primarymenu item. The environment operates such that in response to receipt ofinput data representing a navigational gesture of the user comprisingmotion substantially parallel to the curvilinear orientation, theplurality of secondary menu items scrolls about the curvilinearorientation; and in response to receipt of input data representing anavigational gesture of the user substantially perpendicular to thecurvilinear orientation, an intended secondary menu item in line withthe direction of the navigational gesture is scaled and moved oppositeto the direction of the navigational gesture to facilitate user access.In certain embodiments, the processor is a smart watch and the motionsensor is a touchscreen display.

Embodiments of this invention relate broadly to systems for selectingand activating virtual or real objects and their controllable attributescomprising: at least one motion sensor having an active sensing zone, atleast one processing unit, at least one power supply unit, one object ora plurality of objects under the control of the processing units. Thesensors, processing units, and power supply units are in electricalcommunication with each other. The motion sensors sense motion includingmotion properties within the active zones, generate at least one outputsignal, and send the output signals to the processing units. Theprocessing units convert the output signals into at least one commandfunction. The command functions comprise: (7) a start function, (8) ascroll function, (9) a select function, (10) an attribute function, (11)an attribute control function, (12) a simultaneous control function. Thesimultaneous control functions include: (g) a select and scrollfunction, (h) a select, scroll and activate function, (i) a select,scroll, activate, and attribute control function, (j) a select andactivate function, (k) a select and attribute control function, (1) aselect, active, and attribute control function, or (m) combinationsthereof. The control functions may also include (13) combinationsthereof. The start functions activate at least one selection or cursorobject and a plurality of selectable objects upon first sensing motionby the motion sensors and selectable objects aligned with the motiondirection move toward the selection object or become differentiated fromnon-aligned selectable objects and motion continues until a targetselectable object or a plurality of target selectable objects arediscriminated from non-target selectable objects resulting in activationof the target object or objects. The motion properties include a touch,a lift off, a direction, a velocity, an acceleration, a change indirection, a change in velocity, a change in acceleration, a rate ofchange of direction, a rate of change of velocity, a rate of change ofacceleration, stops, holds, timed holds, or mixtures and combinationsthereof. The objects comprise real world objects, virtual objects andmixtures or combinations thereof, where the real world objects includephysical, mechanical, electro-mechanical, magnetic, electro-magnetic,electrical, or electronic devices or any other real world device thatcan be controlled by a processing unit and the virtual objects includeany construct generated in a virtual world or by a computer anddisplayed by a display device and that are capable of being controlledby a processing unit. The attributes comprise selectable, activatable,executable and/or adjustable attributes associated with the objects. Thechanges in motion properties are changes discernible by the motionsensors and/or the processing units. In certain embodiments, the startfunctions further activate the user feedback units and the selectionobjects and the selectable objects are discernible via the motionsensors in response to movement of an animal, human, robot, roboticsystem, part or parts thereof, or combinations thereof within the motionsensor active zones. In other embodiments, the systems further comprise:at least on user feedback unit, at least one battery backup unit,communication hardware and software, at least one remote control unit,or mixtures and combinations thereof. The sensors, processing units,power supply units, the user feedback units, the battery backup units,the remote control units are in electrical communication with eachother. In other embodiments, the systems further comprise: at least onebattery backup unit, where the battery backup units are in electricalcommunication with the other hardware and units. In other embodiments,faster motion causes a faster movement of the target object or objectstoward the selection object or objects or causes a greaterdifferentiation of the target object or objects from non-target objector objects. In other embodiments, the non-target object or objects moveaway from the selection object as the target object or objects movetoward the selection object or objects to aid in object differentiation.In other embodiments, the target objects and/or the non-target objectsare displayed in list, group, or array forms and are either partially orwholly visible or partially or wholly invisible. In other embodiments,if the activated object or objects have subobjects and/or attributesassociated therewith, then as the object or objects move toward theselection object, the subobjects and/or attributes appear and becomemore discernible as the target object or objects becomes more certain.In other embodiments, the target subobjects and/or the non-targetsubobjects are displayed in list, group, or array forms and are eitherpartially or wholly visible or partially or wholly invisible. In otherembodiments, once the target object or objects have been selected, thenfurther motion within the active zones of the motion sensors causesselectable subobjects or selectable attributes aligned with the motiondirection to move towards, away and/or at an angle to the selectionobject(s) or become differentiated from non-aligned selectablesubobjects or selectable attributes and motion continues until a targetselectable subobject or attribute or a plurality of target selectableobjects and/or attributes are discriminated from non-target selectablesubobjects and/or attributes resulting in activation of the targetsubobject, attribute, subobjects, or attributes. In other embodiments,the motion sensor is selected from the group consisting of digitalcameras, optical scanners, optical roller ball devices, touch pads,inductive pads, capacitive pads, holographic devices, laser trackingdevices, thermal devices, acoustic devices, any other device capable ofsensing motion, arrays of motion sensors, and mixtures or combinationsthereof. In other embodiments, the objects include lighting devices,cameras, ovens, dishwashers, stoves, sound systems, display systems,alarm systems, control systems, medical devices, robots, robotic controlsystems, hot and cold water supply devices, air conditioning systems,heating systems, ventilation systems, air handling systems, computersand computer systems, chemical plant control systems, computer operatingsystems, systems, graphics systems, business software systems, wordprocessor systems, internet browsers, accounting systems, militarysystems, virtual reality systems, augmented reality systems, controlsystems, other software systems, programs, routines, objects and/orelements, remote control systems, or mixtures and combinations thereof.In other embodiments, if the timed hold is brief, then the processingunit causes an attribute to be adjusted to a preset level. In otherembodiments, if the timed hold is continued, then the processing unitcauses an attribute to undergo a high value/low value cycle that endswhen the hold is removed. In other embodiments, the timed hold causes anattribute value to change so that (1) if the attribute is at its maximumvalue, the timed hold causes the attribute value to decrease at apredetermined rate, until the timed hold is removed, (2) if theattribute value is at its minimum value, then the timed hold causes theattribute value to increase at a predetermined rate, until the timedhold is removed, (3) if the attribute value is not the maximum orminimum value, then the timed hold causes randomly selects the rate anddirection of attribute value change or changes the attribute to allowmaximum control, or (4) the timed hold causes a continuous change in theattribute value in a direction of the initial motion until the timedhold is removed. In other embodiments, the motion sensors sense a secondmotion including second motion properties within the active zones,generate at least one output signal, and send the output signals to theprocessing units, and the processing units convert the output signalsinto a confirmation command confirming the selection or at least onesecond command function for controlling different objects or differentobject attributes. In other embodiments, the motion sensors sensemotions including motion properties of two or more animals, humans,robots, or parts thereof, or objects under the control of humans,animals, and/or robots within the active zones, generate output signalscorresponding to the motions, and send the output signals to theprocessing units, and the processing units convert the output signalsinto command function or confirmation commands or combinations thereofimplemented simultaneously or sequentially, where the start functionsactivate a plurality of selection or cursor objects and a plurality ofselectable objects upon first sensing motion by the motion sensor andselectable objects aligned with the motion directions move toward theselection objects or become differentiated from non-aligned selectableobjects and the motions continue until target selectable objects orpluralities of target selectable objects are discriminated fromnon-target selectable objects resulting in activation of the targetobjects and the confirmation commands confirm the selections.

Embodiments of this invention relate broadly to methods for controllingobjects comprising: sensing motion including motion properties within anactive sensing zone of at least one motion sensor, where the motionproperties include a direction, a velocity, an acceleration, a change indirection, a change in velocity, a change in acceleration, a rate ofchange of direction, a rate of change of velocity, a rate of change ofacceleration, stops, holds, timed holds, or mixtures and combinationsthereof, producing an output signal or a plurality of output signalscorresponding to the sensed motion, converting the output signal orsignals via a processing unit in communication with the motion sensorsinto a command function or a plurality of command functions. The commandfunctions comprise: (1) a start function, (2) a scroll function, (3) aselect function, (4) an attribute function, (5) an attribute controlfunction, (6) a simultaneous control function including: (g) a selectand scroll function, (h) a select, scroll and activate function, (i) aselect, scroll, activate, and attribute control function, (j) a selectand activate function, (k) a select and attribute control function, (1)a select, active, and attribute control function, or (m) combinationsthereof, or (7) combinations thereof. The methods also includeprocessing the command function or the command functions simultaneouslyor sequentially, where the start functions activate at least oneselection or cursor object and a plurality of selectable objects uponfirst sensing motion by the motion sensor and selectable objects alignedwith the motion direction move toward the selection object or becomedifferentiated from non-aligned selectable objects and motion continuesuntil a target selectable object or a plurality of target selectableobjects are discriminated from non-target selectable objects resultingin activation of the target object or objects, where the motionproperties include a touch, a lift off, a direction, a velocity, anacceleration, a change in direction, a change in velocity, a change inacceleration, a rate of change of direction, a rate of change ofvelocity, a rate of change of acceleration, stops, holds, timed holds,or mixtures and combinations thereof. The objects comprise real worldobjects, virtual objects or mixtures and combinations thereof, where thereal world objects include physical, mechanical, electro-mechanical,magnetic, electro-magnetic, electrical, or electronic devices or anyother real world device that can be controlled by a processing unit andthe virtual objects include any construct generated in a virtual worldor by a computer and displayed by a display device and that are capableof being controlled by a processing unit. The attributes compriseactivatable, executable and/or adjustable attributes associated with theobjects. The changes in motion properties are changes discernible by themotion sensors and/or the processing units. In certain embodiments, themotion sensor is selected from the group consisting of digital cameras,optical scanners, optical roller ball devices, touch pads, inductivepads, capacitive pads, holographic devices, laser tracking devices,thermal devices, acoustic devices, any other device capable of sensingmotion, arrays of motion sensors, and mixtures or combinations thereof.In other embodiments, the objects include lighting devices, cameras,ovens, dishwashers, stoves, sound systems, display systems, alarmsystems, control systems, medical devices, robots, robotic controlsystems, hot and cold water supply devices, air conditioning systems,heating systems, ventilation systems, air handling systems, computersand computer systems, chemical plant control systems, computer operatingsystems, systems, graphics systems, business software systems, wordprocessor systems, internet browsers, accounting systems, militarysystems, virtual reality systems, augmented reality systems, controlsystems, other software systems, programs, routines, objects and/orelements, remote control systems, or mixtures and combinations thereof.In other embodiments, if the timed hold is brief, then the processingunit causes an attribute to be adjusted to a preset level. In otherembodiments, if the timed hold is continued, then the processing unitcauses an attribute to undergo a high value/low value cycle that endswhen the hold is removed. In other embodiments, the timed hold causes anattribute value to change so that (1) if the attribute is at its maximumvalue, the timed hold causes the attribute value to decrease at apredetermined rate, until the timed hold is removed, (2) if theattribute value is at its minimum value, then the timed hold causes theattribute value to increase at a predetermined rate, until the timedhold is removed, (3) if the attribute value is not the maximum orminimum value, then the timed hold causes randomly selects the rate anddirection of attribute value change or changes the attribute to allowmaximum control, or (4) the timed hold causes a continuous change in theattribute value in a direction of the initial motion until the timedhold is removed. In other embodiments, the methods further comprise:sensing second motion including second motion properties within theactive sensing zone of the motion sensors, producing a second outputsignal or a plurality of second output signals corresponding to thesecond sensed motion, converting the second output signal or signals viathe processing units in communication with the motion sensors into asecond command function or a plurality of second command functions, andconfirming the selection based on the second output signals, orprocessing the second command function or the second command functionsand moving selectable objects aligned with the second motion directiontoward the selection object or become differentiated from non-alignedselectable objects and motion continues until a second target selectableobject or a plurality of second target selectable objects arediscriminated from non-target second selectable objects resulting inactivation of the second target object or objects, where the motionproperties include a touch, a lift off, a direction, a velocity, anacceleration, a change in direction, a change in velocity, a change inacceleration, a rate of change of direction, a rate of change ofvelocity, a rate of change of acceleration, stops, holds, timed holds,or mixtures and combinations thereof. In certain embodiments, sensingmotions including motion properties of two or more animals, humans,robots, or parts thereof within the active zones of the motion sensors,producing output signals corresponding to the motions, converting theoutput signals into command function or confirmation commands orcombinations thereof, where the start functions activate a plurality ofselection or cursor objects and a plurality of selectable objects uponfirst sensing motion by the motion sensor and selectable objects alignedwith the motion directions move toward the selection objects or becomedifferentiated from non-aligned selectable objects and the motionscontinue until target selectable objects or pluralities of targetselectable objects are discriminated from non-target selectable objectsresulting in activation of the target objects and the confirmationcommands confirm the selections.

Suitable Components for Use in the Invention Motion Sensors

Suitable motion sensors include, without limitation, optical sensors,acoustic sensors, thermal sensors, optoacoustic sensors, wave formsensors, pixel differentiators, or any other sensor or combination ofsensors that are capable of sensing movement or changes in movement, ormixtures and combinations thereof. Suitable motion sensing apparatusinclude, without limitation, motion sensors of any form such as digitalcameras, optical scanners, optical roller ball devices, touch pads,inductive pads, capacitive pads, holographic devices, laser trackingdevices, thermal devices, electromagnetic field (EMF) sensors, wave formsensors, any other device capable of sensing motion, changes in EMF,changes in wave form, or the like or arrays of such devices or mixturesor combinations thereof. The sensors may be digital, analog, or acombination of digital and analog. The motion sensors may be touch pads,touchless pads, touch sensors, touchless sensors, inductive sensors,capacitive sensors, optical sensors, acoustic sensors, thermal sensors,optoacoustic sensors, electromagnetic field (EMF) sensors, straingauges, accelerometers, pulse or waveform sensor, any other sensor thatsenses movement or changes in movement, or mixtures and combinationsthereof. The sensors may be digital, analog, or a combination of digitaland analog or any other type. For camera systems, the systems may sensemotion within a zone, area, or volume in front of the lens or aplurality of lens. Optical sensors include any sensor usingelectromagnetic waves to detect movement or motion within in activezone. The optical sensors may operate in any region of theelectromagnetic spectrum including, without limitation, radio frequency(RF), microwave, near infrared (IR), IR, far IR, visible, ultra violet(UV), or mixtures and combinations thereof. Exemplary optical sensorsinclude, without limitation, camera systems, the systems may sensemotion within a zone, area or volume in front of the lens. Acousticsensor may operate over the entire sonic range which includes the humanaudio range, animal audio ranges, other ranges capable of being sensedby devices, or mixtures and combinations thereof. EMF sensors may beused and operate in any frequency range of the electromagnetic spectrumor any waveform or field sensing device that are capable of discerningmotion with a given electromagnetic field (EMF), any other field, orcombination thereof. Moreover, LCD screen(s), other screens and/ordisplays may be incorporated to identify which devices are chosen or thetemperature setting, etc. Moreover, the interface may project a virtualcontrol surface and sense motion within the projected image and invokeactions based on the sensed motion. The motion sensor associated withthe interfaces of this invention can also be acoustic motion sensorusing any acceptable region of the sound spectrum. A volume of a liquidor gas, where a user's body part or object under the control of a usermay be immersed, may be used, where sensors associated with the liquidor gas can discern motion. Any sensor being able to discern differencesin transverse, longitudinal, pulse, compression or any other waveformcould be used to discern motion and any sensor measuring gravitational,magnetic, electro-magnetic, or electrical changes relating to motion orcontact while moving (resistive and capacitive screens) could be used.Of course, the interfaces can include mixtures or combinations of anyknown or yet to be invented motion sensors. The motion sensors may beused in conjunction with displays, keyboards, touch pads, touchlesspads, sensors of any type, or other devices associated with a computer,a notebook computer or a drawing tablet or any mobile or stationarydevice.

Suitable motion sensing apparatus include, without limitation, motionsensors of any form such as digital cameras, optical scanners, opticalroller ball devices, touch pads, inductive pads, capacitive pads,holographic devices, laser tracking devices, thermal devices, EMFsensors, wave form sensors, MEMS sensors, any other device capable ofsensing motion, changes in EMF, changes in wave form, or the like orarrays of such devices or mixtures or combinations thereof. Other motionsensors that sense changes in pressure, in stress and strain (straingauges), changes in surface coverage measured by sensors that measuresurface area or changes in surface are coverage, change in accelerationmeasured by accelerometers, or any other sensor that measures changes inforce, pressure, velocity, volume, gravity, acceleration, any otherforce sensor or mixtures and combinations thereof.

Controllable Objects

Suitable physical mechanical, electro-mechanical, magnetic,electro-magnetic, electrical, or electronic devices, hardware devices,appliances, biometric devices, automotive devices, VR objects, ARobjects, MR objects, and/or any other real world device that can becontrolled by a processing unit include, without limitation, anyelectrical and/or hardware device or appliance having attributes whichcan be controlled by a switch, a joy stick, a stick controller, orsimilar type controller, or software program or object. Exemplaryexamples of such attributes include, without limitation, ON, OFF,intensity and/or amplitude, impedance, capacitance, inductance, softwareattributes, lists or submenus of software programs or objects, haptics,or any other controllable electrical and/or electro-mechanical functionand/or attribute of the device. Exemplary examples of devices include,without limitation, environmental controls, building systems andcontrols, lighting devices such as indoor and/or outdoor lights or lightfixtures, cameras, ovens (conventional, convection, microwave, and/oretc.), dishwashers, stoves, sound systems, mobile devices, displaysystems (TVs, VCRs, DVDs, cable boxes, satellite boxes, and/or etc.),alarm systems, control systems, air conditioning systems (air conditionsand heaters), energy management systems, medical devices, vehicles,robots, robotic control systems, UAV, equipment and machinery controlsystems, hot and cold water supply devices, air conditioning system,heating systems, fuel delivery systems, energy management systems,product delivery systems, ventilation systems, air handling systems,computers and computer systems, chemical plant control systems,manufacturing plant control systems, computer operating systems andother software systems, programs, routines, objects, and/or elements,remote control systems, or the like virtual and augmented realitysystems, holograms, or mixtures or combinations thereof.

Software Systems

Suitable software systems, software products, and/or software objectsthat are amenable to control by the interface of this invention include,without limitation, any analog or digital processing unit or unitshaving single or a plurality of software products installed thereon andwhere each software product has one or more adjustable attributesassociated therewith, or singular software programs or systems with oneor more adjustable attributes, menus, lists or other functions ordisplay outputs. Exemplary examples of such software products include,without limitation, operating systems, graphics systems, businesssoftware systems, word processor systems, business systems, onlinemerchandising, online merchandising systems, purchasing and businesstransaction systems, databases, software programs and applications,internet browsers, accounting systems, military systems, controlsystems, or the like, or mixtures or combinations thereof. Softwareobjects generally refer to all components within a software system orproduct that are controllable by at least one processing unit.

Processing Units

Suitable processing units for use in the present invention include,without limitation, digital processing units (DPUs), analog processingunits (APUs), any other technology that can receive motion sensor outputand generate command and/or control functions for objects under thecontrol of the processing unit, or mixtures and combinations thereof.

Suitable digital processing units (DPUs) include, without limitation,any digital processing unit capable of accepting input from a pluralityof devices and converting at least some of the input into outputdesigned to select and/or control attributes of one or more of thedevices. Exemplary examples of such DPUs include, without limitation,microprocessor, microcontrollers, or the like manufactured by Intel,Motorola, Ericsson, HP, Samsung, Hitachi, NRC, Applied Materials, AMD,Cyrix, Sun Microsystem, Philips, National Semiconductor, Qualcomm, orany other manufacture of microprocessors or microcontrollers.

Suitable analog processing units (APUs) include, without limitation, anyanalog processing unit capable of accepting input from a plurality ofdevices and converting at least some of the input into output designedto control attributes of one or more of the devices. Such analog devicesare available from manufacturers such as Analog Devices Inc.

User Feedback Units

Suitable user feedback units include, without limitation, cathode raytubes, liquid crystal displays, light emitting diode displays, organiclight emitting diode displays, plasma displays, touch screens, touchsensitive input/output devices, audio input/output devices, audio-visualinput/output devices, keyboard input devices, mouse input devices, anyother input and/or output device that permits a user to receive computergenerated output signals and create computer input signals.

DETAILED DESCRIPTION OF THE DRAWING OF THE DISCLOSURE

Referring now to FIGS. 1A-D, a sequence of flat or 2D displayed map andcalendar showing visualization of associated calendar and map data andinteractions thereof is shown.

Looking at FIG. 1A, a display screen is shown, generally 100, to includea calendar window 110 and a map window 150. The calendar window 110include a calendar 112 including a month banner 114 shown here as themonth of January 2017 and the body 116 of the calendar 110 shown in astandard calendar format days in columns day numbers in rows. Thecalendar 110 includes five event entries, Event 1, Event 2, Event 3,Event 4, and Event 5. Event 1 is a five day event spanning January 2-6;Event 2 is a four day event spanning January 10-13; Event 3 is a two dayevent spanning January 19-20; Event 4 is a three day event spanningJanuary 25-27; and Event 5 is a five day event spanning January 30-31.As can be seen, each event has an event icon in each day that the eventlasts so that the Event 1 icon appears in each day of the event. Thecalendar 106 also includes zones for moving backwards and forwardsthrough the months within a given year indicated by “<” and “>” icons,and for moving backwards and forwards through the years indicated by the“<<” and “>>” icons. The calendar 110 also includes hot zones 1-31indicating the calendar days of the month of January, which whenactivated brings up information about the selected day. The calendar 110also includes hot zones Feb, Mar, Apr, May, and Jun for going directlyto the months of February, March, April, May, and June, which wouldupdate based on the current month. Of course, these hot zones mayinclude past and future months or may be user defined. The map window150 includes a road map of the United States 152, continental and Alaskaand Hawaii.

Looking at FIG. 1B, the display screen 100 evidences motion sensedwithin an active zone of a motion sensor above at least one thresholdmotion criteria such as duration, direction, and/or any other thresholdcriteria for distinguishing random motion, where the motion eithercomprises a hold over one of the Event 1 icons or moves towards one ofthe Event 1 icons in a manner that Event 1 is distinguished from all ofthe other events. Once the processing unit determines that the motion issufficient to discriminate the selection of Event 1 from the otherevents, a ray or light beam 154 emanates from the Event 1 icon to alocation 156 on the map 152 corresponding to the location of event, hereLos Angeles. As shown here, the ray or beam 154 is shown as having athickness corresponding to the duration of the event—5 day event, 6 ptline thickness. Additionally, if the motion was in a direction that theprocessing unit could not distinguished between more than one event,then the processing unit would move the event icon is such as way topermit further motion to permit event icon discrimination as set forthherein above.

Looking at FIG. 1C, the display screen 100 evidences motion or a secondmotion sensed within the active zone of the motion sensor, where themotion or second motion either comprises a hold over one of the Event 4icons or moves towards one of the Event 4 icons in a manner that Event 4is distinguished from all of the other events. Once the processing unitdetermines that the motion is sufficient to discriminate the selectionof Event 4 from the other events, a ray or a light beam 158 emanatesfrom the Event 4 icon to a location 160 on the map 152 corresponding tothe location of event, here Chicago. As shown here, the ray or beam 158is shown as having a thickness corresponding to the duration of theevent—3 day event, 3 pt line thickness. Additionally, if the motion wasin a direction that the processing unit could not distinguished betweenmore than one event, then the processing unit would move the event iconis such as way to permit further motion to permit event icondiscrimination as set forth herein above.

Looking at FIG. 1D, the display screen 100 evidences motion or a secondmotion sensed within the active zone of the motion sensor, where themotion or second motion either comprises a hold over the month banner114 or moves towards the month banner 114 in a manner that the monthbanner 114 is distinguished from all of the other selectable objectsincluding the events, the days, the hot zones, and the forward andbackward month and year icons. Once the processing unit determines thatthe motion is sufficient to discriminate the selection of the monthbanner 114 from the other selectable objects, rays or light beams 162a-e emanate from all of the first event icon of each Event 1-5 tolocations 164 a-e on the map 152 corresponding to the location of eachevent, here Los Angeles, Denver, Minneapolis, Chicago, and New York,respectively. The processing unit also causes line segments 166 a-d tobe drawn connecting the city locations 164 a-e in a sequencecorresponding to the event dates. The processing unit may also displayhot zones 168 a-d represented here by circles that when activateddisplay relevant travel information for traveling between each location.Alternatively, the processing unit may be configured to treat each linesegment 166 a-d has a hot zone so that motion towards or onto the linewould result in the display of relevant travel information. The rays orbeams 162 a-e have thickness reflecting the duration of the event. Fiveday events have 6 pt line thickness; four day events have 4.5 pt linethickness; three day events have 3 pt line thickness; two day eventshave 2.25 pt line thickness; and one day events have 1.5 pt linethickness. Further it should be recognized that the events andassociated rays or beams may be and in general would be color coded tobetter distinguish the events. Additionally, the color coding may beindicative of the type of event. Event data may include not onlyspecific information about the event, but may also include informationabout the event location, information on how to get to the event,information about the city in which the event is occurring and any otherrelevant information about the event, the location, the city, the peopleor companies in attending the event, or any other information the usermay desire to be displayed.

Referring now to FIG. 2A-D, a sequence of flat or 2D displayed map,calendar, and event data showing visualization of associated calendar,map, and event data and interactions therebetween is shown.

Looking at FIG. 2A, a display screen is shown, generally 200, to includea calendar window 210, a map window 240, and an event data window 270.The calendar window 210 include a calendar 212 including a month banner214 shown here as the month of January 2017 and the body 216 of thecalendar 210 shown in a standard calendar format days in columns daynumbers in rows. The calendar 210 includes five event entries, Event 1,Event 2, Event 3, Event 4, and Event 5. Event 1 is a five day eventspanning January 2-6; Event 2 is a four day event spanning January10-13; Event 3 is a two day event spanning January 19-20; Event 4 is athree day event spanning January 25-27; and Event 5 is a five day eventspanning January 30-31. As can be seen, each event has an event icon ineach day that the event lasts so that the Event 1 icon appears in eachday of the event. The calendar 106 also includes zones for movingbackwards and forwards through the months within a given year indicatedby “<” and “>” icons, and for moving backwards and forwards through theyears indicated by the “<<” and “>>” icons. It should also be recognizedthat z-axis or other axis motion may be using for processing commandfunctions. The calendar 210 also includes hot zones 1-31 indicating thecalendar days of the month of January, which when activated brings upinformation about the selected day. The calendar 210 also includes hotzones Feb, Mar, Apr, May, and Jun for going directly to the months ofFebruary, March, April, May, and June, which would update based on thecurrent month. Of course, these hot zones may include past and futuremonths or may be user defined. The map window 240 includes a road map ofthe United States 242, continental and Alaska and Hawaii. The eventwindow 270 simply shown a icon indicating that event data is to bedisplayed there. Event data may include not only specific informationabout the event, but may also include information about the eventlocation, information on how to get to the event, information about thecity in which the event is occurring and any other relevant informationabout the event, the location, the city, the people or companies inattending the event, or any other information the user may desire to bedisplayed.

Looking at FIG. 2B, the display screen 200 evidences motion sensedwithin an active zone of a motion sensor above at least one thresholdmotion criteria such as duration, direction, and/or any other thresholdcriteria for distinguishing random motion, where the motion eithercomprises a hold over one of the Event 1 icons or moves towards one ofthe Event 1 icons in a manner that Event 1 is distinguished from all ofthe other events. Once the processing unit determines that the motion issufficient to discriminate the selection of Event 1 from the otherevents, a ray or light beam 244 emanates from the Event 1 icon to alocation 246 on the map 242 corresponding to the location of event, hereLos Angeles. As shown here, the ray or beam 244 is shown as having athickness corresponding to the duration of the event—5 day event, 6 ptline thickness. Additionally, if the motion was in a direction that theprocessing unit could not distinguished between more than one event,then the processing unit would move the event icon is such as way topermit further motion to permit event icon discrimination as set forthherein above. Simultaneously or sequentially, the processing unit alsodisplays information in the event data window 270. The information shownhere includes a picture of the venue 272, a schematic layout of thevenue 274, and an event 1 data box 276. When activated, the box 276 maydisplay event data including event schedule, event speakers, and otherevent information. Simultaneously or sequentially, the processing unitalso generate a ray or beam 248 (shown here as a dotted line) emanatingfrom the location 246 to the event data window 270 and/or may alsogenerate a ray or beam 250 (shown here as a dashed line) emanating fromEvent 1 to the event data window 270.

Looking at FIG. 2C, the display screen 200 evidences motion or a secondmotion sensed within the active zone of the motion sensor, where themotion or second motion either comprises a hold over one of the Event 4icons or moves towards one of the Event 4 icons in a manner that Event 4is distinguished from all of the other events. Once the processing unitdetermines that the motion is sufficient to discriminate the selectionof Event 4 from the other events, a ray or a light beam 252 emanatesfrom the Event 4 icon to a location 254 on the map 242 corresponding tothe location of event, here Chicago. As shown here, the ray or beam 252is shown as having a thickness corresponding to the duration of theevent—3 day event, 3 pt line thickness. Additionally, if the motion wasin a direction that the processing unit could not distinguished betweenmore than one event, then the processing unit would move the event iconis such as way to permit further motion to permit event icondiscrimination as set forth herein above. Simultaneously orsequentially, the processing unit also displays information in the eventdata window 270. The information shown here includes a picture of thevenue 278, a schematic layout of the venue 280, and an event 1 data box282. When activated, the box 282 may display event data including eventschedule, event speakers, and other event information. Simultaneously orsequentially, the processing unit may also generate a ray or beam 256(shown here as a dotted line) emanating from the location 254 to theevent data window 270 and/or a ray or beam 258 (shown here as a dashedline) emanating from Event 4 to the event data window 270.

Looking at FIG. 2D, the display screen 200 evidences motion or a secondmotion sensed within the active zone of the motion sensor, where themotion or second motion either comprises a hold over the month banner214 or moves towards the month banner 214 in a manner that the monthbanner 214 is distinguished from all of the other selectable objectsincluding the events, the days, the hot zones, and the forward andbackward month and year icons. Once the processing unit determines thatthe motion is sufficient to discriminate the selection of the monthbanner 214 from the other selectable objects, rays or light beams 260a-e emanate from all of the first event icon of each Event 1-5 tolocations 262 a-e on the map 242 corresponding to the location of eachevent, here Los Angeles, Denver, Minneapolis, Chicago, and New York,respectively. The processing unit also causes line segments 264 a-d tobe drawn connecting the city locations 262 a-e in a sequencecorresponding to the event dates. The processing unit may also displayhot zones 266 a-d represented here by circles that when activateddisplay relevant travel information for traveling between each location.Alternatively, the processing unit may be configured to treat each linesegment 264 a-d has a hot zone so that motion towards or onto the linewould result in the display of relevant travel information. The rays orbeams 260 a-e have thickness reflecting the duration of the event. Fiveday events have 6 pt line thickness; four day events have 4.5 pt linethickness; three day events have 3 pt line thickness; two day eventshave 2.25 pt line thickness; and one day events have 1.5 pt linethickness. Further it should be recognized that the events andassociated rays or beams may be and in general would be color coded tobetter distinguish the events. Additionally, the color coding may beindicative of the type of event. Event data may include not onlyspecific information about the event, but may also include informationabout the event location, information on how to get to the event,information about the city in which the event is occurring and any otherrelevant information about the event, the location, the city, the peopleor companies in attending the event, or any other information the usermay desire to be displayed. Simultaneously or sequentially, theprocessing unit also displays information in the event data window 270.The information shown here includes an Event 1 Data box 284 a, an Event2 Data box 284 b, an Event 3 Data box 284 c, an Event 4 Data box 284 d,and an Event 5 Data box 284 e. Simultaneously or sequentially, theprocessing unit may also generate a ray or beam 267 a-e (shown here as adotted line) emanating from the locations 262 a-e to the event datawindow 270 and/or a ray or beam 269 a-e (shown here as a dashed line)emanating from Event 1-5 to the event data window 270.

Referring now to FIG. 3A-D, a sequence of 3D displayed map and calendarshowing visualization of associated calendar and map data andinteractions thereof is shown.

Looking at FIG. 3A, a display screen is shown, generally 300, to includea calendar window 310 and a map window 340. The calendar window 310include a calendar 312 including a month banner 314 shown here as themonth of January 2017 and the body 316 of the calendar 310 shown in astandard calendar format days in columns day numbers in rows. Thecalendar 310 includes five event entries, Event 1, Event 2, Event 3,Event 4, and Event 5. Event 1 is a five day event spanning January 2-6;Event 2 is a four day event spanning January 10-13; Event 3 is a two dayevent spanning January 19-20; Event 4 is a three day event spanningJanuary 25-27; and Event 5 is a five day event spanning January 30-31.As can be seen, each event has an event icon in each day that the eventlasts so that the Event 1 icon appears in each day of the event. Thecalendar 310 also includes zones for moving backwards and forwardsthrough the months within a given year indicated by “<” and “>” icons,and for moving backwards and forwards through the years indicated by the“<<” and “>>” icons. The calendar 310 also includes hot zones 1-31indicating the calendar days of the month of January, which whenactivated brings up information about the selected day. The calendar 310also includes hot zones Feb, Mar, Apr, May, and Jun for going directlyto the months of February, March, April, May, and June, which wouldupdate based on the current month. Of course, these hot zones mayinclude past and future months or may be user defined. The map window340 includes a road map of the United States 342, continental and Alaskaand Hawaii.

Looking at FIG. 3B, the display screen 300 evidences motion sensedwithin an active zone of a motion sensor above at least one thresholdmotion criteria such as duration, direction, and/or any other thresholdcriteria for distinguishing random motion, where the motion eithercomprises a hold over one of the Event 1 icons or moves towards one ofthe Event 1 icons in a manner that Event 1 is distinguished from all ofthe other events. Once the processing unit determines that the motion issufficient to discriminate the selection of Event 1 from the otherevents, a ray or light beam 344 emanates from the Event 1 icon to alocation 346 on the map 342 corresponding to the location of event, hereLos Angeles. As shown here, the ray or beam 344 is shown as having athickness corresponding to the duration of the event—5 day event, 6 ptline thickness. Additionally, if the motion was in a direction that theprocessing unit could not distinguished between more than one event,then the processing unit would move the event icon is such as way topermit further motion to permit event icon discrimination as set forthherein above.

Looking at FIG. 3C, the display screen 300 evidences motion or a secondmotion sensed within the active zone of the motion sensor, where themotion or second motion either comprises a hold over one of the Event 4icons or moves towards one of the Event 4 icons in a manner that Event 4is distinguished from all of the other events. Once the processing unitdetermines that the motion is sufficient to discriminate the selectionof Event 4 from the other events, a ray or a light beam 348 emanatesfrom the Event 4 icon to a location 350 on the map 342 corresponding tothe location of event, here Chicago. As shown here, the ray or beam 348is shown as having a thickness corresponding to the duration of theevent—3 day event, 3 pt line thickness. Additionally, if the motion wasin a direction that the processing unit could not distinguished betweenmore than one event, then the processing unit would move the event iconis such as way to permit further motion to permit event icondiscrimination as set forth herein above.

Looking at FIG. 3D, the display screen 300 evidences motion or a secondmotion sensed within the active zone of the motion sensor, where themotion or second motion either comprises a hold over the month banner314 or moves towards the month banner 314 in a manner that the monthbanner 314 is distinguished from all of the other selectable objectsincluding the events, the days, the hot zones, and the forward andbackward month and year icons. Once the processing unit determines thatthe motion is sufficient to discriminate the selection of the monthbanner 314 from the other selectable objects, rays or light beams 352a-e emanate from all of the first event icon of each Event 1-5 tolocations 354 a-e on the map 342 corresponding to the location of eachevent, here Los Angeles, Denver, Minneapolis, Chicago, and New York,respectively. The processing unit also causes line segments 356 a-d tobe drawn connecting the city locations 354 a-e in a sequencecorresponding to the event dates. The processing unit may also displayhot zones 358 a-d represented here by circles that when activateddisplay relevant travel information for traveling between each location.Alternatively, the processing unit may be configured to treat each linesegment 356 a-d has a hot zone so that motion towards or onto the linewould result in the display of relevant travel information. The rays orbeams 352 a-e have thickness reflecting the duration of the event. Fiveday events have 6 pt line thickness; four day events have 4.5 pt linethickness; three day events have 3 pt line thickness; two day eventshave 2.25 pt line thickness; and one day events have 1.5 pt linethickness. Further it should be recognized that the events andassociated rays or beams may be and in general would be color coded tobetter distinguish the events. Additionally, the color coding may beindicative of the type of event. Event data may include not onlyspecific information about the event, but may also include informationabout the event location, information on how to get to the event,information about the city in which the event is occurring and any otherrelevant information about the event, the location, the city, the peopleor companies in attending the event, or any other information the usermay desire to be displayed.

Referring now to FIG. 4A-D, a sequence of 3D displayed map, calendar,and event data showing visualization of associated calendar, map, andevent data and interactions thereof is shown.

Looking at FIG. 4A, a display screen is shown, generally 400, to includea calendar window 410, a map window 440, and an event data window 470.The calendar window 410 include a calendar 412 including a month banner414 shown here as the month of January 2017 and the body 416 of thecalendar 410 shown in a standard calendar format days in columns daynumbers in rows. The calendar 410 includes five event entries, Event 1,Event 2, Event 3, Event 4, and Event 5. Event 1 is a five day eventspanning January 2-6; Event 2 is a four day event spanning January10-13; Event 3 is a two day event spanning January 19-20; Event 4 is athree day event spanning January 25-27; and Event 5 is a five day eventspanning January 30-31. As can be seen, each event has an event icon ineach day that the event lasts so that the Event 1 icon appears in eachday of the event. The calendar 410 also includes zones for movingbackwards and forwards through the months within a given year indicatedby “<” and “>” icons, and for moving backwards and forwards through theyears indicated by the “<<” and “>>” icons. The calendar 410 alsoincludes hot zones 1-31 indicating the calendar days of the month ofJanuary, which when activated brings up information about the selectedday. The calendar 410 also includes hot zones Feb, Mar, Apr, May, andJun for going directly to the months of February, March, April, May, andJune, which would update based on the current month. Of course, thesehot zones may include past and future months or may be user defined. Themap window 440 includes a road map of the United States 442, continentaland Alaska and Hawaii. The event window 470 simply shown a iconindicating that event data is to be displayed there. Event data mayinclude not only specific information about the event, but may alsoinclude information about the event location, information on how to getto the event, information about the city in which the event is occurringand any other relevant information about the event, the location, thecity, the people or companies in attending the event, or any otherinformation the user may desire to be displayed.

Looking at FIG. 4B, the display screen 400 evidences motion sensedwithin an active zone of a motion sensor above at least one thresholdmotion criteria such as duration, direction, and/or any other thresholdcriteria for distinguishing random motion, where the motion eithercomprises a hold over one of the Event 1 icons or moves towards one ofthe Event 1 icons in a manner that Event 1 is distinguished from all ofthe other events. Once the processing unit determines that the motion issufficient to discriminate the selection of Event 1 from the otherevents, a ray or light beam 444 emanates from the Event 1 icon to alocation 446 on the map 442 corresponding to the location of event, hereLos Angeles. As shown here, the ray or beam 444 is shown as having athickness corresponding to the duration of the event—5 day event, 6 ptline thickness. Additionally, if the motion was in a direction that theprocessing unit could not distinguished between more than one event,then the processing unit would move the event icon is such as way topermit further motion to permit event icon discrimination as set forthherein above. Simultaneously or sequentially, the processing unit alsodisplays information in the event data window 470. The information shownhere includes a picture of the venue 472, a schematic layout of thevenue 474, and an event 1 data box 476. When activated, the box 476 maydisplay event data including event schedule, event speakers, and otherevent information. Simultaneously or sequentially, the processing unitalso generate a ray or beam 448 (shown here as a dotted line) emanatingfrom the location 446 to the event data window 470 and/or may alsogenerate a ray or beam 450 (shown here as a dashed line) emanating fromEvent 1 to the event data window 470.

Looking at FIG. 4C, the display screen 400 evidences motion or a secondmotion sensed within the active zone of the motion sensor, where themotion or second motion either comprises a hold over one of the Event 4icons or moves towards one of the Event 4 icons in a manner that Event 4is distinguished from all of the other events. Once the processing unitdetermines that the motion is sufficient to discriminate the selectionof Event 4 from the other events, a ray or a light beam 452 emanatesfrom the Event 4 icon to a location 454 on the map 442 corresponding tothe location of event, here Chicago. As shown here, the ray or beam 452is shown as having a thickness corresponding to the duration of theevent—3 day event, 3 pt line thickness. Additionally, if the motion wasin a direction that the processing unit could not distinguished betweenmore than one event, then the processing unit would move the event iconis such as way to permit further motion to permit event icondiscrimination as set forth herein above. Simultaneously orsequentially, the processing unit also displays information in the eventdata window 470. The information shown here includes a picture of thevenue 478, a schematic layout of the venue 480, and an event 1 data box482. When activated, the box 482 may display event data including eventschedule, event speakers, and other event information. Simultaneously orsequentially, the processing unit may also generate a ray or beam 458(shown here as a dotted line) emanating from the location 454 to theevent data window 470 and/or a ray or beam 460 (shown here as a dashedline) emanating from Event 4 to the event data window 470.

Looking at FIG. 4D, the display screen 400 evidences motion or a secondmotion sensed within the active zone of the motion sensor, where themotion or second motion either comprises a hold over the month banner414 or moves towards the month banner 414 in a manner that the monthbanner 414 is distinguished from all of the other selectable objectsincluding the events, the days, the hot zones, and the forward andbackward month and year icons. Once the processing unit determines thatthe motion is sufficient to discriminate the selection of the monthbanner 414 from the other selectable objects, rays or light beams 462a-e emanate from all of the first event icon of each Event 1-5 tolocations 464 a-e on the map 442 corresponding to the location of eachevent, here Los Angeles, Denver, Minneapolis, Chicago, and New York,respectively. The processing unit also causes line segments 466 a-d tobe drawn connecting the city locations 264 a-e in a sequencecorresponding to the event dates. The processing unit may also displayhot zones 468 a-d represented here by circles that when activateddisplay relevant travel information for traveling between each location.Alternatively, the processing unit may be configured to treat each linesegment 466 a-d has a hot zone so that motion towards or onto the linewould result in the display of relevant travel information. The rays orbeams 462 a-e have thickness reflecting the duration of the event. Fiveday events have 6 pt line thickness; four day events have 4.5 pt linethickness; three day events have 3 pt line thickness; two day eventshave 2.25 pt line thickness; and one day events have 1.5 pt linethickness. Further it should be recognized that the events andassociated rays or beams may be and in general would be color coded tobetter distinguish the events. Additionally, the color coding may beindicative of the type of event. Event data may include not onlyspecific information about the event, but may also include informationabout the event location, information on how to get to the event,information about the city in which the event is occurring and any otherrelevant information about the event, the location, the city, the peopleor companies in attending the event, or any other information the usermay desire to be displayed. Simultaneously or sequentially, theprocessing unit also displays information in the event data window 470.The information shown here includes an Event 1 Data box 484 a, an Event2 Data box 484 b, an Event 3 Data box 484 c, an Event 4 Data box 484 d,and an Event 5 Data box 484 e. Simultaneously or sequentially, theprocessing unit may also generate a ray or beam 467 a-e (shown here as adotted line) emanating from the locations 464 a-e to the event datawindow 470 and/or a ray or beam 469 a-e (shown here as a dashed line)emanating from Event 1-5 to the event data window 470.

CLOSING

All references cited herein are incorporated by reference. Although theinvention has been disclosed with reference to its preferredembodiments, from reading this description those of skill in the art mayappreciate changes and modification that may be made which do not departfrom the scope and spirit of the invention as described above andclaimed hereafter.

We claim:
 1. A method comprising: receiving first input from a motionsensor; displaying a calendar and a map in response to the first input,where the calendar includes a plurality of events and the map correlateswith event locations; determining that the first input corresponds tomotion towards a particular event on the calendar; and generating a rayor beam emanating from the particular event to a location on the mapcorresponding to the location of the particular event.
 2. The method ofclaim 1, further comprising: receiving a further input from the motionsensor; determining that the further input corresponds to motion towardsa further event on the calendar; generating a further ray or beamemanating from the further particular event to a further location on themap corresponding to the location of the further particular event. 3.The method of claim 2, further comprising: generating a line connectingthe first location to the further location evidencing a direction oftravel from the first location to the further location.
 4. The method ofclaim 2, further comprising: repeating the steps of claims 1 and 2 untilall desired events and associated with rays or beams are displayed onthe display device.
 5. The method of claim 3, further comprising:repeating the steps of claims 1, 2 and 3 until all desired events andassociated with rays or beams and all connecting lines are displayed onthe display device.
 6. The method of claim 1, further comprising:displaying event related data in a event data field on the display. 7.The method of claim 2, further comprising: displaying event related datain a event data field on the display.
 8. The method of claim 3, furthercomprising: displaying event related data in a event data field on thedisplay.
 9. The method of claim 1, wherein the calendar and the map aredisplayed in a two dimensional format with the calendar displayed on topof the map or the map is displayed on top of the calendar.
 10. Themethod of claim 1, wherein the calendar and the map are displayed in athree dimensional format with the map displayed in a xz-plane and thecalendar displayed in an xy-plane.
 11. The method of claim 6, whereinthe calendar, the map, and the event are displayed in a two dimensionalformat with (a) the calendar displayed on top of the map and the map ontop of the event data field or (b) the map is displayed on top of thecalendar and the calendar on top of the event data field.
 12. The methodof claim 6, wherein the calendar and the map are displayed in a threedimensional format with the map displayed in a xz-plane, the calendardisplayed in an xy-plane, and the even data field is displayed on ayz-plane.
 12. The method of claim 11, further comprising: displayinglines extending from events to event data displayed on in the event datafield and lines extending from the associated locations to the eventdata displayed in the event data field on the display.
 13. The method ofclaim 12, further comprising: displaying lines extending from events toevent data displayed on in the event data field and lines extending fromthe associated locations to the event data displayed in the event datafield on the display
 14. A mobile device comprising: a display device;and a processor configured to: responsive to first input, initiatedisplay of a calendar and a map on the display device, where thecalendar includes a plurality of events and the map correlates withevent locations; and responsive to the first input determine that firstinput corresponds to motion towards a particular event on the calendarand generate a ray or beam emanating from the particular event to alocation on the map corresponding to the location of the particularevent.
 15. A system comprising: a display device configured to: displaya calendar and a map in two-dimensions or in three-dimensions; and aprocessor, coupled to the display device and configured to: receive afirst input from a motion sensor, cause the display device to displaythe calendar and the map, where the calendar includes a plurality ofevents and the map correlates with event locations, and in response tothe first input determine that first input corresponds to motion towardsa particular event on the calendar and generate a ray or beam emanatingfrom the particular event to a location on the map corresponding to thelocation of the particular event.